-- Logs begin at Thu 2022-07-07 02:35:58 UTC, end at Thu 2022-07-07 04:27:13 UTC. -- Jul 07 03:49:47.288221 dv-cinder-846842-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 03:49:47.297266 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 03:49:47 2022] *** Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: nodename: dv-cinder-846842-11-iscsi Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: machine: x86_64 Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: clock source: unix Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: pcre jit disabled Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: detected number of CPU cores: 4 Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: current working directory: / Jul 07 03:49:47.299223 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: detected binary path: /usr/bin/uwsgi-core Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: your processes number limit is 47680 Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: your memory page size is 4096 bytes Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: detected max file descriptor number: 2048 Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: lock engine: pthread robust mutexes Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: thunder lock: enabled Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 03:49:47.299912 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 03:49:47.342408 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: Python main interpreter initialized at 0x55bd671449c0 Jul 07 03:49:47.342408 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: python threads support enabled Jul 07 03:49:47.342408 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: your server socket listen backlog is limited to 100 connections Jul 07 03:49:47.342408 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: your mercy for graceful operations on workers is 90 seconds Jul 07 03:49:47.342753 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 03:49:47.342828 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: *** Operational MODE: preforking *** Jul 07 03:49:47.343064 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: *** uWSGI is running in multiple interpreter mode *** Jul 07 03:49:47.343064 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: spawned uWSGI master process (pid: 103304) Jul 07 03:49:47.343248 dv-cinder-846842-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 03:49:47.343772 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: spawned uWSGI worker 1 (pid: 103305, cores: 1) Jul 07 03:49:47.345543 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: spawned uWSGI worker 2 (pid: 103306, cores: 1) Jul 07 03:49:47.345543 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 03:49:48.015002 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 03:49:48.016928 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 03:49:49.153720 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:49.153720 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes Jul 07 03:49:49.154457 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:49.154457 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: from cryptography.utils import int_from_bytes Jul 07 03:49:49.154871 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:49.154871 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes Jul 07 03:49:49.155007 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:49.155007 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: from cryptography.utils import int_from_bytes Jul 07 03:49:51.657742 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:49:51.658436 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:49:51.658533 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:49:51.658853 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:49:51.659109 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:49:51.659501 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.659824 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.659929 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:49:51.660341 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.660443 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:49:51.660535 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.660736 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:49:51.660829 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.661086 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.661183 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:49:51.661351 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:49:51.661447 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.661714 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.661806 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662046 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662162 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662309 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662422 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662625 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662716 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.662948 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-11-iscsi {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663045 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663268 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663372 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663672 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663886 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.663984 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664205 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664329 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664497 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664594 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664816 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.664917 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.665145 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.665243 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-11-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.665455 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.665627 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.665795 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666055 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666163 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666364 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666464 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666669 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.666759 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.667010 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.667668 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.667970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.668064 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.668371 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.668508 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.668697 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.668829 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669007 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669141 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669331 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669456 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669657 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.669896 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.670132 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-11-iscsi {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.670373 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.670589 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.670844 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.671054 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.671279 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.671495 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.671741 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.671741 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.672178 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.672394 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.672603 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.672603 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.672977 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-11-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673165 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673329 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673479 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673657 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673816 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.673961 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674106 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674286 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674443 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674591 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674737 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.674883 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675039 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675185 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675325 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675486 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675666 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675827 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.675978 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676125 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676264 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676444 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676591 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676730 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.676934 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677083 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677223 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677378 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677646 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677804 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.677968 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678107 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678292 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678465 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678611 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678767 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678914 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.678914 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679189 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679189 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679468 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679625 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679773 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.679920 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680067 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680212 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680406 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680548 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680691 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680829 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.680976 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681125 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681266 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681422 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681562 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681713 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.681854 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682004 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682145 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682283 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682421 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682566 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.682812 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.683361 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.683511 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.683663 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.683810 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.683967 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684117 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684298 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684445 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684604 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684749 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.684889 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685040 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685186 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685334 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685480 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685640 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.685780 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686006 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686161 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686302 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686441 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686590 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686729 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.686876 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687023 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687172 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687318 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687465 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687759 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.687916 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688055 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688207 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688384 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688525 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688676 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688832 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.688973 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689111 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689260 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689400 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689568 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689716 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689716 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.689979 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690128 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690274 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690422 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690570 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690716 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690855 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.690999 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691145 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691296 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691452 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691600 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691739 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.691877 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692024 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692171 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692328 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692482 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692631 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692770 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.692918 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693063 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693209 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693364 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693503 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693641 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693789 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.693928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694065 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694203 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694341 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694484 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694636 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694775 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.694921 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695072 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695227 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695366 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695516 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695656 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695801 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.695947 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696087 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696231 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696453 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696602 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696741 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.696899 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697045 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697210 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697358 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697537 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697833 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.697982 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.698122 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.698809 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.699404 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.699556 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.699698 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.699837 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.699987 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700147 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700321 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700468 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700617 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700757 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.700895 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701044 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701190 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701329 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701467 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701612 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701751 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.701898 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702048 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702188 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702341 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702481 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702626 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702775 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.702915 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703061 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703209 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703348 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703487 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703635 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703782 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.703932 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704078 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704225 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704439 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704588 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704728 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.704866 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.705005 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.705144 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.705292 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.705431 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.705577 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.705715 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.705870 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.706021 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.706170 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.706318 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.706457 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.706601 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.706741 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:51.706888 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707027 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707172 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707318 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707457 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707617 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.707771 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708061 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708200 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708385 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708529 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708679 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.708969 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709107 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709253 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709394 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709532 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709690 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709836 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.709982 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.710183 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.710419 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.710572 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.710733 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.710874 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711012 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711151 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711296 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711435 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711598 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711745 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.711885 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712023 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712162 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712347 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712501 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712643 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712789 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.712931 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713076 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713224 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713364 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713513 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713653 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713792 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.713962 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.714558 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.714707 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.714848 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715000 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715140 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715286 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715441 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715583 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715723 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.715874 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716021 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716173 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716337 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716337 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716619 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716762 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.716900 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717048 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717203 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717343 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717482 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717636 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.717779 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718075 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718231 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718371 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718511 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718649 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718789 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.718937 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719077 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719216 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719355 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719494 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719643 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719792 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719941 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.719941 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720205 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720400 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720695 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720834 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.720975 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721123 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721263 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721415 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721572 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721712 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.721857 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722247 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722389 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722541 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722688 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722828 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.722967 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723107 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723252 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723405 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723545 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723694 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723834 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.723972 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724120 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724261 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724442 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724592 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724732 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.724878 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725030 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725172 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725311 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725451 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725607 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725747 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.725895 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726035 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726185 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726333 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726480 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726620 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726772 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.726926 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727073 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727212 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727367 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727520 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727660 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727805 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.727945 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.728228 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.728441 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.728593 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.728733 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.728880 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.729028 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.729168 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.729307 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.729470 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.730508 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.730665 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.730807 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.730947 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731096 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731247 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731387 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731528 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731668 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731808 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.731957 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732098 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732249 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732429 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732572 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732712 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.732860 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733001 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733140 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733279 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733418 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733566 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733716 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.733856 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734006 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734147 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734286 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734426 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734716 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734856 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.734994 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735133 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735314 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735457 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735597 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735737 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.735886 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736026 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736246 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736427 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736570 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736711 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736857 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.736998 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737183 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737337 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737478 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737625 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737767 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.737923 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738083 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738372 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738519 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738658 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738799 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.738948 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739087 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739226 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739376 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739515 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739654 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739805 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.739961 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740101 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740239 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740499 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740648 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740798 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.740940 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741078 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741217 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741362 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741501 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741648 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741789 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.741939 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742085 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742225 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742372 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742512 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742650 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742788 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.742938 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743079 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743227 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743366 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743505 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743643 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743792 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.743940 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744096 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744236 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744404 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744558 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744699 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.744855 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.745005 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.745212 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.745808 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.745964 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746120 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746268 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746418 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746559 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746705 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746846 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.746985 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747139 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747282 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747421 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747567 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747707 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.747846 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748004 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748152 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748326 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748489 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748639 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748639 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.748913 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749065 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749205 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749345 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749484 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749484 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749756 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.749756 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750031 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750178 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750325 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750473 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750622 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750762 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.750902 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751048 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751187 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751334 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751475 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751625 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751775 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.751914 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752059 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752208 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752406 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752583 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752737 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.752878 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753016 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753173 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753314 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753461 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753612 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753753 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.753900 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754049 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754189 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754335 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754482 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754631 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754788 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.754929 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755068 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755206 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755351 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755505 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755658 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755799 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.755946 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756086 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756224 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756401 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756552 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756694 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756840 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.756981 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757127 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757268 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757425 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757566 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757705 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757844 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.757993 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758145 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758285 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758425 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758622 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758782 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.758924 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759073 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759220 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759377 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759518 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759657 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759797 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.759949 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.760089 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.760229 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.760405 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.760547 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.760685 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.761423 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762013 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762168 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762327 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762474 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762629 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762777 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.762937 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763084 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763237 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763390 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763546 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763838 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.763984 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764141 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764313 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764313 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764620 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764768 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.764923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765071 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765216 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765443 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765592 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765738 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.765883 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766029 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766198 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766198 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766476 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766629 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766785 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.766940 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767097 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767244 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767389 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767542 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767689 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767842 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.767998 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768167 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768381 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768481 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768598 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768689 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768778 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768778 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768921 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.768989 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769062 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769134 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769218 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769295 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769366 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769432 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769497 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769561 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769633 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769707 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769773 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769837 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769901 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.769972 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770050 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770124 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770200 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770265 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770328 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770391 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770456 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770527 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770622 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770691 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770756 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.770821 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771034 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771159 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771365 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771591 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771671 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771909 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.771998 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772226 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772335 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772590 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772687 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772893 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.772988 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773229 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773334 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773530 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773622 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773845 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.773939 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774153 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774248 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774471 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774557 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774781 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.774875 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775086 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775172 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775407 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775492 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775710 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.775814 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776012 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776098 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776335 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776721 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776813 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.776890 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777020 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777176 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777320 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777525 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777622 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777863 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.777956 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778211 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778296 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778516 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778610 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778816 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.778906 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779124 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779210 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779490 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779594 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779729 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.779821 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780034 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780119 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780358 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780465 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780664 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780750 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.780967 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781052 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781275 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781371 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781661 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781884 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.781968 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782183 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782269 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782489 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782573 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782790 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.782874 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783091 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783177 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783394 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783484 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783702 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.783788 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784007 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784092 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784328 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784416 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784642 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784737 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.784953 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785037 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785255 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785339 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785557 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785649 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785864 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.785948 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786166 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786249 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786468 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786634 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786772 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.786856 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787080 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787165 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787391 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787485 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787694 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.787778 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788000 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788084 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788321 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788409 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788627 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788712 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.788932 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789021 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789240 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789327 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789540 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789634 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789844 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.789936 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790147 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790233 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790449 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790533 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790751 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.790836 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791076 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791164 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791386 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791482 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791689 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.791784 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.792525 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.792618 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.792861 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793032 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793291 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793432 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793602 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793696 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.793944 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794029 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794253 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794353 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794563 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794656 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794872 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.794957 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795179 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795272 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795488 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795573 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795802 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.795887 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796108 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796202 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796440 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796527 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796749 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.796835 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797060 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797146 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797364 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797449 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797668 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797761 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.797991 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798085 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798304 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798389 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798614 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798699 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.798935 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799021 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799256 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799340 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799574 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799672 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799874 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.799965 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800185 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800309 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800522 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800619 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800827 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.800912 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801133 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801218 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801444 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801573 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801755 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.801858 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802064 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802150 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802374 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802467 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802684 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802769 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.802992 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803078 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803295 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803388 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803604 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803690 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803910 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.803995 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804214 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804330 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804551 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804635 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804865 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.804953 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805177 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805263 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805491 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805576 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805806 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.805901 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806113 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806198 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806416 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806507 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806727 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.806843 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.807035 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.807155 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.807348 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.807466 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.808313 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.808430 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.808643 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.808830 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809066 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809171 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809393 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809488 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809706 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.809793 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810025 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810119 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810337 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810432 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810653 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810738 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.810962 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811046 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811341 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811430 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811649 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811746 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.811951 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812037 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812265 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812380 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812611 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812708 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.812918 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813004 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813223 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813310 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813527 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813660 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813835 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.813927 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814143 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814258 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814464 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814578 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814877 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.814962 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815188 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815275 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815493 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815593 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815802 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.815903 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816117 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816203 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816469 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816570 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816780 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.816943 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817090 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817176 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817400 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817486 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817726 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.817822 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818037 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818123 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818358 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818449 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818683 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.818769 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819007 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819111 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819320 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819417 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819633 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819784 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.819939 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820099 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820262 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820436 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820605 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820764 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.820919 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821089 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821241 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821419 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821652 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821752 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.821975 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822074 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822288 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822373 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822610 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822696 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.822935 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823021 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823279 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823380 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823588 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823724 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.823932 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824097 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824243 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824460 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824561 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824794 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.824881 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825116 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825201 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825526 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825618 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825771 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.825865 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826079 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826188 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826381 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826507 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826684 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.826834 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827006 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827165 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827310 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827474 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827631 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827770 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.827942 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828084 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828262 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828420 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828610 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828730 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.828915 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829061 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829238 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829377 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829552 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829688 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.829855 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830001 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830160 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830313 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830462 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830621 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830803 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.830927 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831109 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831251 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831431 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831559 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831761 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.831885 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832090 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832188 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832424 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832538 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832758 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.832865 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833084 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833172 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833400 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833487 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833718 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.833804 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834042 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834128 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834347 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834440 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834650 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834744 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.834960 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835263 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835363 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835588 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835690 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835870 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.835956 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836179 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836264 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836506 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836809 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.836894 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837110 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837195 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837430 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837523 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837735 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.837820 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838055 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838175 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838365 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838459 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838669 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.838756 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839042 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839177 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839351 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839488 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839661 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839833 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.839970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840139 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840299 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840509 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840597 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840827 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.840914 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841150 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841249 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841479 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841566 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841790 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.841875 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842180 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842279 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842425 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842525 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842733 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.842819 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843040 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843345 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843431 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843659 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843744 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.843974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844061 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844308 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844397 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844624 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844712 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.844940 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845034 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845256 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845343 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845571 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845655 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.845900 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846102 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846222 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846432 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846543 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846750 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.846865 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.847317 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.847439 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.847630 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.847761 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.847944 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848081 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848256 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848422 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848591 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848742 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.848904 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849062 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849217 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849381 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849527 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849708 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.849859 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850181 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850275 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850508 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850594 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850842 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.850936 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851159 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851255 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851474 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851568 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851789 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.851876 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852105 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852197 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852461 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852562 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852780 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.852867 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853084 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853178 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853400 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853494 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853712 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.853805 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.854026 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.854113 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.854339 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.854473 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855240 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855313 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855530 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855607 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855852 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.855940 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856173 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856260 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856517 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856611 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856875 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.856961 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857192 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857278 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857501 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857660 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857820 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.857906 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858139 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858233 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858453 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858546 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858766 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.858850 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859078 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859162 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859396 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859596 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859713 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.859912 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860030 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860247 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860367 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860596 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860682 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.860920 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861006 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861238 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861332 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861557 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861642 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861883 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.861970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862188 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862287 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862495 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862580 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862803 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.862888 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.863117 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.863341 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.863427 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.863665 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.863750 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864005 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864101 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864339 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864433 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864665 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864752 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.864977 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865077 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865298 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865509 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865628 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865857 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.865952 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866172 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866267 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866498 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866584 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866824 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.866919 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867133 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867217 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867435 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867527 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867758 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.867852 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868064 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868148 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868391 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868479 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868706 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.868808 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869018 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869250 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869335 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869598 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869684 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869904 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.869989 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.870400 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.870499 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.870737 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.870892 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871170 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871256 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871487 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871580 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871811 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.871908 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872117 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872204 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872447 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872584 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872754 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.872855 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873065 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873151 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873371 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873456 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873674 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873767 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.873981 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874068 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874285 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874370 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874590 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874720 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874890 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.874984 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875196 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875281 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875496 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875581 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875806 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.875902 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876107 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876194 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876436 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876524 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876750 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.876835 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877060 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877159 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877369 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877455 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877674 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877765 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.877978 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878071 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878289 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878374 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878590 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878673 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.878906 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879001 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879213 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879299 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879525 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879675 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879831 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.879926 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.880144 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.880408 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.880520 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.880750 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.880836 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881077 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881164 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881414 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881501 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881737 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.881834 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882044 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882132 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882351 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882440 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882659 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882753 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.882970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883054 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883281 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883366 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883599 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883694 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.883909 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884150 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884236 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884516 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884604 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884841 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.884933 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.885150 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.885235 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.885461 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.885555 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.886325 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.886430 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.886638 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.886749 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887003 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887100 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887259 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887382 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887568 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887701 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.887880 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888043 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888222 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888327 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888566 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888652 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888880 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.888967 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889194 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889280 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889509 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889594 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889818 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.889905 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890129 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890214 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890436 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890523 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890744 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.890831 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891056 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891149 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891369 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891454 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891684 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891770 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.891989 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892075 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892359 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892465 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892680 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892814 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.892998 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893085 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893316 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893415 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893629 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893715 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.893944 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894037 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894255 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894350 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894565 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894650 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894879 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.894963 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895189 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895274 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895515 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895599 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895823 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.895909 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896162 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896248 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896512 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896610 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896818 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.896904 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897124 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897211 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897427 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897512 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897735 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.897834 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898054 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898141 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898363 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898449 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898665 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898760 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.898966 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899272 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899358 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899572 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899667 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899874 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.899985 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.900174 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.900402 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.900570 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.900714 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.900877 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.901024 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.901176 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.901331 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.901713 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.901808 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902039 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902162 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902441 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902663 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902750 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.902969 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903055 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903276 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903361 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903581 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903668 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903885 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.903970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904188 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904308 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904515 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904599 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904816 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.904901 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905119 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905216 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905424 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905511 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905729 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.905815 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906036 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906130 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906342 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906428 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906647 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906740 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.906959 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907052 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907265 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907351 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907574 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907667 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907877 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.907963 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908183 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908293 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908509 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908594 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908837 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.908930 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909146 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909231 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909454 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909539 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909764 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.909857 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910072 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910157 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910380 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910474 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910693 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.910778 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911015 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911099 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911320 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911414 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911725 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.911952 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912037 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912281 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912385 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912602 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912689 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912912 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.912997 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913222 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913315 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913537 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913622 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913844 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.913930 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914155 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914240 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914464 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914548 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914773 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.914864 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915085 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915172 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915401 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915486 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915718 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.915805 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916042 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916129 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916373 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916461 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916698 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.916859 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.917540 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.917636 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.917861 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.917999 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918177 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918278 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918496 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918586 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918815 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.918901 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919128 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919440 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919525 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919748 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919834 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.919991 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:49:51.920078 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.920419 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.920734 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.921063 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.921392 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.921740 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.922056 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.922402 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.922733 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.923050 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.923366 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.923676 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:51.923922 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:49:51.982166 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Registered counter for database nova_api Jul 07 03:49:51.985714 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Registered counter for database nova_api Jul 07 03:49:52.096582 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.098547 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-2962a283-48aa-4013-ac68-883f6681cada None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.103336 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.105542 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.159486 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.context [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5717acc1-d5f0-4013-b056-915d6f43a1e7(cell1) {{(pid=103306) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 03:49:52.160262 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.context [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5717acc1-d5f0-4013-b056-915d6f43a1e7(cell1) {{(pid=103305) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 03:49:52.163481 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:49:52.164167 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:49:52.165099 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:49:52.165753 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:49:52.165893 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:49:52.166536 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:49:52.168615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_concurrency.lockutils [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:49:52.169394 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:49:52.170574 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Registered counter for database nova_cell0 Jul 07 03:49:52.171337 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Registered counter for database nova_cell0 Jul 07 03:49:52.174426 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Registered counter for database nova_cell1 Jul 07 03:49:52.175264 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Registered counter for database nova_cell1 Jul 07 03:49:52.181661 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.183396 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-2962a283-48aa-4013-ac68-883f6681cada None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.187216 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-2962a283-48aa-4013-ac68-883f6681cada None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.187519 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.188739 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.190128 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.326915 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.328748 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.335601 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Registered counter for database nova_cell0 Jul 07 03:49:52.337769 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO dbcounter [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Registered counter for database nova_cell0 Jul 07 03:49:52.344872 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-2962a283-48aa-4013-ac68-883f6681cada None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.348627 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG oslo_db.sqlalchemy.engines [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:49:52.349481 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.353026 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writer thread running {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:49:52.686373 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:49:52.687005 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-2962a283-48aa-4013-ac68-883f6681cada None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:49:52.693535 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:49:52.693649 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:49:53.035143 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:49:53.035425 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-2962a283-48aa-4013-ac68-883f6681cada None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:49:53.041020 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: WARNING keystonemiddleware.auth_token [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:49:53.041284 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:49:53.046313 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd671449c0 pid: 103306 (default app) Jul 07 03:49:53.046546 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd671449c0 pid: 103305 (default app) Jul 07 03:49:53.048386 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:49:53.049558 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-9693178e-b932-491f-b566-fc573c5edcf4 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 07 03:49:53.049958 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Thu Jul 7 03:49:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:07.943180 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:07.944443 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-2962a283-48aa-4013-ac68-883f6681cada None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 07 03:51:07.944848 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:07.956973 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.957915 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell1:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.958636 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell0:SELECT=3 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.959534 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.401712 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-d17f250f-2db3-4fc7-9231-93ed0122cd3f admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:08.432960 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-d17f250f-2db3-4fc7-9231-93ed0122cd3f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.481353 Jul 07 03:51:08.433493 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 7 03:51:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:10.508472 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-2962a283-48aa-4013-ac68-883f6681cada None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:10.509484 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-2962a283-48aa-4013-ac68-883f6681cada None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 07 03:51:10.510105 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:10.569873 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-66cfb4e0-6ea7-45f3-aa2c-3bf250a4386c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:10.588641 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:51:10.588641 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: warnings.warn(msg) Jul 07 03:51:10.620603 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-66cfb4e0-6ea7-45f3-aa2c-3bf250a4386c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104472 Jul 07 03:51:10.621179 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:10.635493 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:10.636902 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:10.638145 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:10.638936 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:10.847607 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f89569f4-a3f2-4d00-a5e7-27a449fc6d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:10.850023 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:51:10.850023 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:51:10.917321 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f89569f4-a3f2-4d00-a5e7-27a449fc6d04 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287520 Jul 07 03:51:10.917987 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 7 03:51:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:13.004655 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-66cfb4e0-6ea7-45f3-aa2c-3bf250a4386c admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:13.005669 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-66cfb4e0-6ea7-45f3-aa2c-3bf250a4386c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 07 03:51:13.006069 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:13.111945 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-89e352e8-f0d6-4751-aed8-dab218bf96d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:13.129931 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:51:13.129931 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:51:13.148041 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-89e352e8-f0d6-4751-aed8-dab218bf96d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135509 Jul 07 03:51:13.149317 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 03:51:13.161696 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-8bbe711d-11fa-4b92-960a-8c544342e29d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:13.163151 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:51:13.163151 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: warnings.warn(msg) Jul 07 03:51:13.195597 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-8bbe711d-11fa-4b92-960a-8c544342e29d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037540 Jul 07 03:51:13.196161 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 7 03:51:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:15.301427 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-89e352e8-f0d6-4751-aed8-dab218bf96d3 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:15.302474 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-89e352e8-f0d6-4751-aed8-dab218bf96d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 07 03:51:15.302851 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:15.363886 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e4ea4fcf-5aec-438f-b1e4-b62d5a3415fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "swap": 0}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:15.383616 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e4ea4fcf-5aec-438f-b1e4-b62d5a3415fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074711 Jul 07 03:51:15.384170 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:15.396744 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0802a432-e3d4-4cc2-a303-3fa1a04e0b64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:15.421648 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0802a432-e3d4-4cc2-a303-3fa1a04e0b64 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028641 Jul 07 03:51:15.422502 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 7 03:51:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:17.531471 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-e4ea4fcf-5aec-438f-b1e4-b62d5a3415fe admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:17.532524 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-e4ea4fcf-5aec-438f-b1e4-b62d5a3415fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 07 03:51:17.532937 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:51:17.593138 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-a5e5c89d-d676-4158-9876-9e0e122010ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "name": "ds2G"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:17.611720 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-a5e5c89d-d676-4158-9876-9e0e122010ee admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073057 Jul 07 03:51:17.612261 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:17.624029 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-d24c0088-dbde-4f1e-9a59-193997ee8b2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:17.647072 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-d24c0088-dbde-4f1e-9a59-193997ee8b2b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026936 Jul 07 03:51:17.647802 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 7 03:51:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:19.728214 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-a5e5c89d-d676-4158-9876-9e0e122010ee admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:19.729216 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-a5e5c89d-d676-4158-9876-9e0e122010ee admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 07 03:51:19.729610 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:19.789418 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:19.806409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070864 Jul 07 03:51:19.806949 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 03:51:19.819267 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-e1fbd4d3-c04c-4714-bab6-2bc0a87408d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:19.848915 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-e1fbd4d3-c04c-4714-bab6-2bc0a87408d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033249 Jul 07 03:51:19.849512 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jul 7 03:51:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:21.960072 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:21.961147 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 07 03:51:21.961725 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:22.023831 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-1dd56efe-18ba-4c28-92dc-e5aa1447aef8 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:22.047310 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-1dd56efe-18ba-4c28-92dc-e5aa1447aef8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079017 Jul 07 03:51:22.048699 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 7 03:51:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:51:24.300500 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:24.301723 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-5e2fcc0a-051c-4bb5-be6b-97ce4fd71cf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jul 07 03:51:24.302190 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:24.368043 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-219e7fd4-ed75-4716-b4d1-7e371c8d304b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:24.387622 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-219e7fd4-ed75-4716-b4d1-7e371c8d304b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079713 Jul 07 03:51:24.388168 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:24.401330 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-99c7e8cd-b3ca-4119-914f-c3aa6fca85ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:24.425804 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-99c7e8cd-b3ca-4119-914f-c3aa6fca85ac admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029087 Jul 07 03:51:24.426382 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 7 03:51:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:26.801123 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-219e7fd4-ed75-4716-b4d1-7e371c8d304b admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:26.802248 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-219e7fd4-ed75-4716-b4d1-7e371c8d304b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 07 03:51:26.802690 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:51:26.865654 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-34896d51-7620-4037-9a06-1c180ce97ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:26.885958 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-34896d51-7620-4037-9a06-1c180ce97ed5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077275 Jul 07 03:51:26.886449 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:26.898432 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c76f88d3-88dd-48b2-ae20-918bd3f01a54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:26.922065 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-c76f88d3-88dd-48b2-ae20-918bd3f01a54 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027235 Jul 07 03:51:26.922648 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 7 03:51:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:29.011222 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-34896d51-7620-4037-9a06-1c180ce97ed5 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:29.013294 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-34896d51-7620-4037-9a06-1c180ce97ed5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002869 Jul 07 03:51:29.013994 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:29.101678 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-24b88cb7-f52d-4f5d-910d-98469669b14b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:29.119488 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-24b88cb7-f52d-4f5d-910d-98469669b14b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.099641 Jul 07 03:51:29.120028 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:29.135597 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-49abe3c8-b9d0-4366-8f40-fedfef74c9ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:29.171746 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-49abe3c8-b9d0-4366-8f40-fedfef74c9ee admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042602 Jul 07 03:51:29.172822 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 7 03:51:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:31.259202 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-24b88cb7-f52d-4f5d-910d-98469669b14b admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:31.260370 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-24b88cb7-f52d-4f5d-910d-98469669b14b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 07 03:51:31.260850 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:31.318704 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-cba97b3c-356a-41c8-80d4-1c8472c8efed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "vcpus": 4, "id": "4", "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:31.337169 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-cba97b3c-356a-41c8-80d4-1c8472c8efed admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069886 Jul 07 03:51:31.337800 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:31.350407 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-37d83521-0b8a-40a1-a8c9-5a872938ad95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:31.373183 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-37d83521-0b8a-40a1-a8c9-5a872938ad95 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026408 Jul 07 03:51:31.373771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 7 03:51:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:33.448807 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-cba97b3c-356a-41c8-80d4-1c8472c8efed admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:33.450353 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-cba97b3c-356a-41c8-80d4-1c8472c8efed admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Jul 07 03:51:33.452814 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:33.521655 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "ram": 16384}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:33.540808 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082141 Jul 07 03:51:33.541359 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jul 7 03:51:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:33.553361 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-edc98be8-05b9-4e28-a6d9-913d3010babe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:51:33.580710 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-edc98be8-05b9-4e28-a6d9-913d3010babe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031156 Jul 07 03:51:33.581644 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jul 7 03:51:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:57.912131 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:57.913167 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 07 03:51:57.913578 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:57.924171 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.972032 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-c893343a-722d-4f4f-b7f7-3cf826d31a1e admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:57.988701 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-c893343a-722d-4f4f-b7f7-3cf826d31a1e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069072 Jul 07 03:51:57.989216 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 7 03:51:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:51:58.915022 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:58.916007 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-421fac8a-029d-444a-9044-23005c882c7c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jul 07 03:51:58.916432 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:51:59.102065 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3eeeb39d-4b0a-45a0-975d-5aef18b4f6de admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:59.107759 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-3eeeb39d-4b0a-45a0-975d-5aef18b4f6de admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3eeeb39d-4b0a-45a0-975d-5aef18b4f6de admin admin] Request method failure captured: Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABixlheLqdw09uZJRHQU90kO6QZDHy-oBLYrIG5l2voBJ8ry1gOaD4007WyYvavkaRWdPCp7fD90JcoqDORS8mZ9QFjb9OJlbXH0KKI6SE1keCyoJS9UTpKjzZcG0pCW1VvqLNzGxnYKo70Pduh3DLYjuyiET5aqt5fWG1yEu3uYM0NuuI Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Role: admin,member,reader Jul 07 03:51:59.111005 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Roles: admin,member,reader Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User: admin Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: method: > Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: exception: Flavor 42 could not be found. Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: action_args: {'id': '42'} Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:51:59.112575 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:51:59.113409 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.114974 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-3eeeb39d-4b0a-45a0-975d-5aef18b4f6de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:51:59.116379 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-3eeeb39d-4b0a-45a0-975d-5aef18b4f6de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061250 Jul 07 03:51:59.116379 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 7 03:51:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 03:51:59.122542 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-ba361fc9-bf4f-4f19-8451-cfb5825af34d admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:59.125543 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.144736 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-ba361fc9-bf4f-4f19-8451-cfb5825af34d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025760 Jul 07 03:51:59.145271 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:51:59.155568 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-215ba542-7b4a-4543-b9a6-b9b7942f8f59 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:59.176467 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-215ba542-7b4a-4543-b9a6-b9b7942f8f59 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025164 Jul 07 03:51:59.177001 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:51:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:51:59.186703 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-97fcb8ba-f958-48ff-a2f9-326e1f5136be admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:51:59.193997 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-97fcb8ba-f958-48ff-a2f9-326e1f5136be admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-97fcb8ba-f958-48ff-a2f9-326e1f5136be admin admin] Request method failure captured: Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABixlheLqdw09uZJRHQU90kO6QZDHy-oBLYrIG5l2voBJ8ry1gOaD4007WyYvavkaRWdPCp7fD90JcoqDORS8mZ9QFjb9OJlbXH0KKI6SE1keCyoJS9UTpKjzZcG0pCW1VvqLNzGxnYKo70Pduh3DLYjuyiET5aqt5fWG1yEu3uYM0NuuI Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Role: admin,member,reader Jul 07 03:51:59.197354 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Roles: admin,member,reader Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User: admin Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: method: > Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: exception: Flavor 42 could not be found. Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: action_args: {'id': '42'} Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:51:59.198923 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:51:59.200603 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:51:59.202052 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-97fcb8ba-f958-48ff-a2f9-326e1f5136be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:51:59.203286 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-97fcb8ba-f958-48ff-a2f9-326e1f5136be admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016122 Jul 07 03:51:59.203286 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 7 03:51:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 07 03:52:00.017606 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-215ba542-7b4a-4543-b9a6-b9b7942f8f59 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:00.018618 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-215ba542-7b4a-4543-b9a6-b9b7942f8f59 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 07 03:52:00.019009 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:00.206261 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ba0903d-e542-48ef-b32f-236d79ea4ca5 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:00.212103 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-5ba0903d-e542-48ef-b32f-236d79ea4ca5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ba0903d-e542-48ef-b32f-236d79ea4ca5 admin admin] Request method failure captured: Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABixlhgV1J-d8MoMG_nhv3y6o84PnBxBuhYtuzNMDhivAfbhVhBXcXhRY18EEMxpuPEOj-FvonZ6qC3aFsIxWB1p-zgd007mQPViS8eJNhDxAQ6AuxarbaLIDBoQhGfgz6NtyoVLP7YLy1puKXIwokdCHYxOymSi4RGstm_ZgIfeNrPgsw Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Role: admin,member,reader Jul 07 03:52:00.213641 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Roles: admin,member,reader Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User: admin Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: method: > Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: exception: Flavor 84 could not be found. Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: action_args: {'id': '84'} Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:52:00.215695 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:00.216771 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.218086 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ba0903d-e542-48ef-b32f-236d79ea4ca5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:52:00.219368 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5ba0903d-e542-48ef-b32f-236d79ea4ca5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059570 Jul 07 03:52:00.219368 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 7 03:52:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 03:52:00.224916 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-639b5d9e-5513-4fcd-8755-4366a0131dca admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:00.239478 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-639b5d9e-5513-4fcd-8755-4366a0131dca admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018000 Jul 07 03:52:00.239933 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:52:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:00.249328 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-ed807569-2b31-4654-b030-da1e19227847 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:00.262872 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-ed807569-2b31-4654-b030-da1e19227847 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017240 Jul 07 03:52:00.263411 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:52:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:00.272287 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-7542c89f-924f-4c89-9b6a-93fba9d6b3ec admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:00.278321 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-7542c89f-924f-4c89-9b6a-93fba9d6b3ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-7542c89f-924f-4c89-9b6a-93fba9d6b3ec admin admin] Request method failure captured: Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABixlhgV1J-d8MoMG_nhv3y6o84PnBxBuhYtuzNMDhivAfbhVhBXcXhRY18EEMxpuPEOj-FvonZ6qC3aFsIxWB1p-zgd007mQPViS8eJNhDxAQ6AuxarbaLIDBoQhGfgz6NtyoVLP7YLy1puKXIwokdCHYxOymSi4RGstm_ZgIfeNrPgsw Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Role: admin,member,reader Jul 07 03:52:00.279828 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Roles: admin,member,reader Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User: admin Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: method: > Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: exception: Flavor 84 could not be found. Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: action_args: {'id': '84'} Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:52:00.281343 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:00.282228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:00.283571 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-7542c89f-924f-4c89-9b6a-93fba9d6b3ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:52:00.284811 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-7542c89f-924f-4c89-9b6a-93fba9d6b3ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012405 Jul 07 03:52:00.284811 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jul 7 03:52:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 07 03:52:01.099965 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-ed807569-2b31-4654-b030-da1e19227847 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:01.101053 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-ed807569-2b31-4654-b030-da1e19227847 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 07 03:52:01.101699 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:01.288136 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-f8f2aa39-fa70-47f8-9578-e69cb8778bfa admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:01.294619 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.wsgi [None req-f8f2aa39-fa70-47f8-9578-e69cb8778bfa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-f8f2aa39-fa70-47f8-9578-e69cb8778bfa admin admin] Request method failure captured: Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept: application/json Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Accept-Encoding: gzip, deflate Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Connection: keep-alive Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Content-Length: 0 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Host: 10.222.0.20 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-Api-Version: compute 2.90 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Openstack-System-Scope: None Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: User-Agent: python-novaclient Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Auth-Token: gAAAAABixlhhfZXycjgPKaQ4Qkh9tWb1e6Fun8u-1GV1RVdEQ4A_hpWL18_g7_qEhT41djIUTGjV9Ygs3y1T69LS1yb7u4p9KXtXs9X1kb0sMYdDA_GsbSnX5KtGK0RynE0dYawVd3RBQW8plb2GDCf02WhDzOvAS9vQZPSaFLPxEWE3UdmX_Mo Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Id: None Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Domain-Name: None Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Identity-Status: Confirmed Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Is-Admin-Project: True Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Id: default Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Domain-Name: Default Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Project-Name: admin Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Role: admin,member,reader Jul 07 03:52:01.296127 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Roles: admin,member,reader Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant: admin Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-Tenant-Name: admin Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User: admin Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Id: default Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Domain-Name: Default Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: X-User-Name: admin Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: method: > Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: exception: Flavor 451 could not be found. Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: action_args: {'id': '451'} Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:52:01.297693 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:01.298615 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.299928 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-f8f2aa39-fa70-47f8-9578-e69cb8778bfa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:52:01.301130 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-f8f2aa39-fa70-47f8-9578-e69cb8778bfa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060255 Jul 07 03:52:01.301130 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:52:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 03:52:01.307011 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5396628d-3b58-48d4-bc15-d19495bb7119 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:01.321063 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5396628d-3b58-48d4-bc15-d19495bb7119 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017510 Jul 07 03:52:01.321519 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:01.336002 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:01.352064 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020400 Jul 07 03:52:01.352619 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jul 7 03:52:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:01.362292 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7a5858f-01f2-477a-a6b7-d27b40179614 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:01.367539 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-f7a5858f-01f2-477a-a6b7-d27b40179614 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7a5858f-01f2-477a-a6b7-d27b40179614 admin admin] Request method failure captured: Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept: application/json Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Connection: keep-alive Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Content-Length: 0 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Host: 10.222.0.20 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABixlhhfZXycjgPKaQ4Qkh9tWb1e6Fun8u-1GV1RVdEQ4A_hpWL18_g7_qEhT41djIUTGjV9Ygs3y1T69LS1yb7u4p9KXtXs9X1kb0sMYdDA_GsbSnX5KtGK0RynE0dYawVd3RBQW8plb2GDCf02WhDzOvAS9vQZPSaFLPxEWE3UdmX_Mo Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Id: None Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Domain-Name: None Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Project-Name: admin Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Role: admin,member,reader Jul 07 03:52:01.369046 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Roles: admin,member,reader Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/538be8cb632d44c2ae0c41188e707132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_538be8cb632d44c2ae0c41188e707132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant: admin Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 538be8cb632d44c2ae0c41188e707132 Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User: admin Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Id: d1d228d8e9614133b10240a134fcb286 Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: X-User-Name: admin Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: method: > Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: exception: Flavor 451 could not be found. Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: action_args: {'id': '451'} Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:52:01.370554 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:01.372447 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Jul 07 03:52:01.373671 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7a5858f-01f2-477a-a6b7-d27b40179614 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:52:01.374911 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f7a5858f-01f2-477a-a6b7-d27b40179614 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011587 Jul 07 03:52:01.374911 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:52:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 03:52:02.188239 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:02.189261 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 07 03:52:02.189681 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:02.379204 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0b2a84dc-c4d2-491d-8720-6e6aefb2e56d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:52:02.398147 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0b2a84dc-c4d2-491d-8720-6e6aefb2e56d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069996 Jul 07 03:52:02.398684 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 7 03:52:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:03.229724 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:03.231608 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Jul 07 03:52:03.232025 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:03.422114 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c291e881-04a9-4eef-9b39-6df80e7bae0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:52:03.439484 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-c291e881-04a9-4eef-9b39-6df80e7bae0a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068456 Jul 07 03:52:03.439956 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 7 03:52:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:04.295696 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:04.296739 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 07 03:52:04.297120 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:04.485270 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5b157cc6-fbdc-46fb-8a78-9717ec00e968 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:52:04.502124 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5b157cc6-fbdc-46fb-8a78-9717ec00e968 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069552 Jul 07 03:52:04.502661 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 7 03:52:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:05.315219 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:05.316602 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Jul 07 03:52:05.317001 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:05.505709 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c5ccc2be-9deb-40a7-8a9a-7506990804bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:52:05.523321 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-c5ccc2be-9deb-40a7-8a9a-7506990804bc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069276 Jul 07 03:52:05.523908 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jul 7 03:52:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:06.340232 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:06.341257 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jul 07 03:52:06.341650 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:06.529861 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-a94e6eeb-2e80-4b45-b558-00d9c59acebd admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:06.549277 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-a94e6eeb-2e80-4b45-b558-00d9c59acebd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071835 Jul 07 03:52:06.549742 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Jul 7 03:52:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:53.305989 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.307001 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-fc4a10f0-1b77-4ce3-be9c-a6be0bc9f128 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 07 03:52:53.307385 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:52:53.317996 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:53.366297 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-69320a9a-f66b-4d03-8ae0-000a4b9b26ac admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.385060 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-69320a9a-f66b-4d03-8ae0-000a4b9b26ac admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071521 Jul 07 03:52:53.385583 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:52:53.409104 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-f3aba5e6-d6c5-44b0-a306-03143c0dc45e admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.412504 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG dbcounter [-] [103306] Writing DB stats nova_api:SELECT=14 {{(pid=103306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:53.418439 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-f3aba5e6-d6c5-44b0-a306-03143c0dc45e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012853 Jul 07 03:52:53.418946 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:52:53.429996 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f21114cc-6396-419b-b833-80cb29f8785e admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.437741 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f21114cc-6396-419b-b833-80cb29f8785e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011235 Jul 07 03:52:53.438260 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:52:53.449860 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.457872 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011787 Jul 07 03:52:53.458393 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:52:53.470092 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5eb9db80-1116-4d63-9214-11c3e4451302 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:52:53.477882 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5eb9db80-1116-4d63-9214-11c3e4451302 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011081 Jul 07 03:52:53.478380 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jul 7 03:52:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:56:11.975496 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:11.976535 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 07 03:56:11.976933 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:56:12.119128 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=6 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:12.234371 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:12.235583 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:56:12.235583 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:56:12.236804 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:12.237239 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:12.238012 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:12.238438 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:12.271263 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-43cc4caf-949d-4ac0-bacc-bce82b76dccb admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153487 Jul 07 03:56:12.271800 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:56:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:56:13.098228 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:13.099218 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 07 03:56:13.099603 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:56:13.288968 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:13.290131 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:56:13.290131 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:56:13.291293 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:13.291725 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:13.292547 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:13.292970 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:13.312619 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-fb82886e-1811-4028-8f7c-7ac9f1eef412 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075328 Jul 07 03:56:13.313147 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:56:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 03:56:24.552713 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:24.553701 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 07 03:56:24.554083 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:56:24.695461 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:24.696095 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:24.696717 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=8 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:24.745131 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:24.746284 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:56:24.746284 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:56:24.747454 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:24.747889 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:24.749271 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:24.749696 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:24.773863 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-3aead8a5-2dba-4078-8521-6dfff8a4d604 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082834 Jul 07 03:56:24.774400 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:56:24 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:56:25.600978 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: DEBUG nova.api.openstack.wsgi [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] Calling method '>' {{(pid=103306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:25.601999 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: INFO nova.api.openstack.requestlog [None req-bf9a9b31-0cf7-4570-92fe-04cfd0c67a14 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 07 03:56:25.602397 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: [pid: 103306|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jul 7 03:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:56:25.794130 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:56:25.795882 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:56:25.795882 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: warnings.warn(msg) Jul 07 03:56:25.797100 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:25.797539 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:25.798357 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:56:25.798782 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:56:25.819997 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-149aa56b-505c-480a-894e-33768c74d819 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077838 Jul 07 03:56:25.820565 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jul 7 03:56:25 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:57:23.567305 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: Thu Jul 7 03:57:23 2022 - graceful shutdown triggered... Jul 07 03:57:23.567438 dv-cinder-846842-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 07 03:57:23.568373 dv-cinder-846842-11-iscsi devstack@n-api.service[103306]: Gracefully killing worker 2 (pid: 103306)... Jul 07 03:57:23.568769 dv-cinder-846842-11-iscsi devstack@n-api.service[103305]: Gracefully killing worker 1 (pid: 103305)... Jul 07 03:57:24.569457 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: worker 1 buried after 1 seconds Jul 07 03:57:24.569874 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: worker 2 buried after 1 seconds Jul 07 03:57:24.569874 dv-cinder-846842-11-iscsi devstack@n-api.service[103304]: goodbye to uWSGI. Jul 07 03:57:24.571087 dv-cinder-846842-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 07 03:57:24.571626 dv-cinder-846842-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 07 03:57:24.574433 dv-cinder-846842-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 03:57:24.584614 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 03:57:24 2022] *** Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: nodename: dv-cinder-846842-11-iscsi Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: machine: x86_64 Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: clock source: unix Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: pcre jit disabled Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: detected number of CPU cores: 4 Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: current working directory: / Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: detected binary path: /usr/bin/uwsgi-core Jul 07 03:57:24.586628 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: your processes number limit is 47680 Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: your memory page size is 4096 bytes Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: detected max file descriptor number: 2048 Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: lock engine: pthread robust mutexes Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: thunder lock: enabled Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 03:57:24.587310 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 03:57:24.632463 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: Python main interpreter initialized at 0x55f46b6419c0 Jul 07 03:57:24.632463 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: python threads support enabled Jul 07 03:57:24.632463 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: your server socket listen backlog is limited to 100 connections Jul 07 03:57:24.632463 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: your mercy for graceful operations on workers is 90 seconds Jul 07 03:57:24.632926 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 03:57:24.632926 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: *** Operational MODE: preforking *** Jul 07 03:57:24.633193 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: *** uWSGI is running in multiple interpreter mode *** Jul 07 03:57:24.633193 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: spawned uWSGI master process (pid: 117979) Jul 07 03:57:24.633407 dv-cinder-846842-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 03:57:24.634047 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: spawned uWSGI worker 1 (pid: 117994, cores: 1) Jul 07 03:57:24.634415 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: spawned uWSGI worker 2 (pid: 117995, cores: 1) Jul 07 03:57:24.635910 dv-cinder-846842-11-iscsi devstack@n-api.service[117979]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 03:57:25.296229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 03:57:25.296847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 03:57:26.496996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:57:26.496996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: from cryptography.utils import int_from_bytes Jul 07 03:57:26.498703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:57:26.498703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: from cryptography.utils import int_from_bytes Jul 07 03:57:26.499457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:57:26.499457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: from cryptography.utils import int_from_bytes Jul 07 03:57:26.499896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:57:26.499896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: from cryptography.utils import int_from_bytes Jul 07 03:57:28.786825 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:57:28.787342 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:57:28.787551 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:57:28.787921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:57:28.788182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:57:28.788599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.788932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.789257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.789379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:57:28.789756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.789896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.790012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:57:28.790210 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.790516 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:57:28.790616 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.790842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.790949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:57:28.791148 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:57:28.791238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.791430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.791549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.791744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.791887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-11-iscsi {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792219 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792575 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.792916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793055 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.793892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.794002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.794837 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.794951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.795083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.795419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.795552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-11-iscsi {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796180 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.796945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.797955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.798980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-11-iscsi {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.799954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.800153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.800250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.800639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.800759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.801947 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.802162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.802280 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.802483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.802615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.802902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-11-iscsi {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803325 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803547 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803639 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.803958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.804197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.804341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.804593 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.804696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.804975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.805184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.805405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.805564 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.805724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.805876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.806963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807067 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807759 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.807952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.808974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.809165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.809293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.809487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.809620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.809929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810770 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.810890 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.811831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.812042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.812172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.812475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.812595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.812926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813062 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813334 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.813963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814437 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.814908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.815917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816240 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816817 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.816959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817679 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.817999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818333 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.818978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.819960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.820185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.820544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.820644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821409 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821595 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.821976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.822486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.822486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.822807 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.822965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.823975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.824994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.825915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.825915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.826964 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.827877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828066 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828210 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828404 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.828862 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829543 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.829865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.830195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.830355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.830506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.830619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.830936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.831916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.832103 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.832383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.832645 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.832799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.832950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833416 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.833977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.834905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835595 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.835834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.836837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.837006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.837134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.837334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.837479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.837666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.837831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.837984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.838153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.838299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.838493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.838602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.838832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.838925 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:57:28.839157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.839250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.839474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.839589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.839796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.839947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.840129 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.840303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.840476 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.840620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.840795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.841496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.841825 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.842016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.842187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.842446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.842631 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.842789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.843041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.843229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.843385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.843651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.843827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.844110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.844302 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.844487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.844691 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.844843 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.845982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.846224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.846323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.846633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.846733 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.846962 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.847256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.847351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.847615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.847717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.847965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.848171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.848321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.848625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.848726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.848956 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.849124 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.849274 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.849574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.849665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.849899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.850027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.850228 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.850512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.850647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851638 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.851819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.852144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.852347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.852863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853569 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.853964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.854139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.854299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.854584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.854741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.854894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.855194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.855356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.855500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.855746 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.855911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.856218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.857321 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.857850 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.858264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.858659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.859037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.859199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.859390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.859730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.859882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.860208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.860588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.860948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.861306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.861502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.861639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.861954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.862145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.862330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.862553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.862670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.862907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.863008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.863228 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.863446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.863540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.863870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.864011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.864190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.864537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.864675 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.864977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.865103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.865298 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.865633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.865797 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.865937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.866241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.866383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.866564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.866779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.866981 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.867198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.867368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.867504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.867828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.867973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.868148 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.868477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.868582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.868812 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.868914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.869163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.869363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.869506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.869793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.869884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.870143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.870247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.870478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.870665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.870801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.871098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.871202 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.871474 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.871637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.871731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.872035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.872218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.872515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.872662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.873076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.873175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.873486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.873580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.873932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.874030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.874354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.874450 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.874764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.874869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.875084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.875224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.875423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.875662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.875753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.876048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.876157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.876402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.876630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.876739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.877064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.877167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.877379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.877527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.877734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.878046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.878199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.878399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.878618 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.878734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879048 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879694 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.879967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.880059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.880351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.880447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.880677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.880854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.881000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.881307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.881409 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.881642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.881923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.882091 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.882285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.882391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.882605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.882913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883351 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883557 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.883909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.884214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.884338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.884588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.884681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.884920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885076 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885860 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.885962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.886180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.886401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.886501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.886804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.886897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.887130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.887289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.887451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.887716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.887916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.888256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.888386 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.888526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.888842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.888984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.889171 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.889482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.890230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.890331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.890465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.890465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.890969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.891097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.891329 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.891590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.891986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.891986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.892213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.892385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.892697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.892826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893023 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893373 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.893975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.894300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.894424 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.894627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.894880 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895253 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.895984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.896199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900798 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.900938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901096 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.901939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902025 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902235 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902311 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902380 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.902612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.903132 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.903223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.903309 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.903389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.903973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904235 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.904937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.905963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906281 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.906901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907068 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907387 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907680 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.907830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.908401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.908581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.908756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.908918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.909255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.909412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.909565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.909565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.909854 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910758 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.910900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911041 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911333 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.911909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.912994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.913884 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914026 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914529 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914691 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.914984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.915881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916030 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916361 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.916947 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.917979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.918512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.918664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.918829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.918975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.919889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.920203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.920456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.920619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.920772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.920924 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.921078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.921078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.921943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.922866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923016 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.923899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.924052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.924320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.924608 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.924608 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.925105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.925353 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.925647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.925841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.926022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.926201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.926436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.926696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.926966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.927252 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.927540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.927815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.927815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.929018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.929234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.929495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.929742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.929742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.930318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.930476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.930476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.930769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.930920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931237 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931380 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931672 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.931912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.932162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.932446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.932685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.932938 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.933782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.934182 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.934341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.934486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.934628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.934826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.935169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.935335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.935547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.935704 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.935871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.936943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937092 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.937861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.938005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.938162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.938311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.938465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.938902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939531 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.939987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.940434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.940587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.940741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.940741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941461 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.941969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942417 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942561 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.942852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.943078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.943316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.943641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.943891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944517 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.944968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.945119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.945263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.945450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.945684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.945943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.946189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.946449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.946603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.946756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.946909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.947053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.947204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.947370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.947547 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.947794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.948048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.948290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.948290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.948763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.949577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.949802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.950037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.950613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.950905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.951156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.951313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.951527 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.951697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.951902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.952152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.952422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.952422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.952869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.953123 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.953378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.953628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.953628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954443 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.954930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955667 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955667 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.955945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956433 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.956887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957038 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957181 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957793 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.957982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.958161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.958359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.958540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.958728 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.959204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.959702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.959897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.959897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.960244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.960524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.960836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.960999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961591 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.961892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962043 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962193 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962336 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962818 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.962964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.963999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.964142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.964501 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.964669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.964827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.964971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.965160 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.965394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.965625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.965906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.966658 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.966921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.967906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.968049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.968201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.968369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.968589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.968832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.969100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.969940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.970094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.970248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.970407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.970571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.970781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.971985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972799 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.972943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973675 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.973972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.974122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.974278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.974421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.974759 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.974920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975066 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975208 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.975965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.976117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.976261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.976438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.976614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.976821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.977039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.977281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.977776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.978008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.978215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.978462 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.978711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.978985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.979240 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.979504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980308 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.980932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.981234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.981234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.981525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.982344 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.982565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.982808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983776 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.983918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.984209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.984407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.984563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.984806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.984806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.985963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.986940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.987811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988709 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.988861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.989005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.989163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.989394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.989548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.989717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.990391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.990544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.990688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.990845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.991011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.991497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.991749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.992008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.992353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.992622 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.992783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.992930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.993965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.994185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.994418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.994642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.994642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.995199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.995199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.995605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.995832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.996064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.996319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.996663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.996916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.997153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.997153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.997647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.997809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.997988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.998152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.998314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.998499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.998698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.998915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.999125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.999360 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.999608 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:28.999832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.000679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.001043 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.001263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.001746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.001988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.002236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.002452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.002612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.002822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.003005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.003356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.003616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.003854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.004094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.004441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.004653 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.004810 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.004956 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005813 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.005970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006569 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.006864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007738 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.007891 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008034 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008363 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.008957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.009835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.010117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.010469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.010807 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.010957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.011238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.011388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.011531 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.011849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.011999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.012150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.012367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.012532 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.012677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.013338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.013500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.013644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.013802 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.013954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014098 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.014891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015193 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015753 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.015896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.016871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.017103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.017369 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.017642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.017951 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.018217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.018492 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.018750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.019044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.019302 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.019546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.019768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.019768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.020239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.021151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.021151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.021802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.022251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.022493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.022493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.022940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.022940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.023392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.023651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.023888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.024067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.024236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.024415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.024577 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.024823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.025063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.025231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.025394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.025777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.025947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.026884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.027968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.029765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.030022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.030192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.030343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.030501 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.030866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.031351 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.031796 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.032114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.032627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.032792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.032955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033420 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033732 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.033880 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.034079 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.034315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.034569 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.034840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.034840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.035306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.035482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.035718 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.035966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.036143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.036143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.036499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.036763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.037082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.037082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.037578 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.037741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.037956 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.038108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.038259 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.038424 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.038579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.038836 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.039113 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.039370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.039606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.039832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.040066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.040066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.040066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.040066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.040066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.041739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.042107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.042358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.042825 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.043064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.043304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.043551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.043785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.044036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.044321 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.044571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.044821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.045991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.046134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.046289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.046616 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.046801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.046801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.047966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048499 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048839 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.048959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049376 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.049955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.050162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.053210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.053425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.053590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.053590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.053893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.054766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055819 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.055975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.056921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.057227 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.057390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.057566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.057806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.058977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.059171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.059366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.059366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.059780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.060074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.060074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.060479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.061358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.061358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.061706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.061867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.062018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.062182 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.062343 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.062494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.062645 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.063471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.063471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.063471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.064878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065381 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.065690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.066791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.067821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.068966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.069965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070613 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.070921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.071072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.071222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.071467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.071728 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.071997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.072261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.072562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.072825 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.073968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.074634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.076944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.077383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.077544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.077704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.077865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078016 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078174 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.078959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.079975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080135 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080329 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080660 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080812 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.080969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.081121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.081298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.081472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.081709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.081944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.082161 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.082414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.082631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.082785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.082785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.083072 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.083255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.084495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.084674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.084844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.084996 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085155 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.085940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086096 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.086879 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.087978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088814 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.088977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.089284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.089444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.089444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.089763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.090010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.090010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.090497 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.090764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.091650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.091932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.091932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.092372 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.092613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.092613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.092904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.093065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.093065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.093372 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.093845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.094985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.095213 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.095438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.095624 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.095789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.095950 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.096110 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.096300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.096553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.096957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.097236 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.097515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.097795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.097952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098111 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098443 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.098901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.099858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.100009 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.100167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.100364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.100531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.100531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.101005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.103566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.108988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.109901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.110897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.112489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.113463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.114854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.115897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.117148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.119481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:57:29.120426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:57:29.227884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Registered counter for database nova_api Jul 07 03:57:29.250531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.259423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.288444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO dbcounter [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Registered counter for database nova_api Jul 07 03:57:29.310544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_db.sqlalchemy.engines [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.317510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.context [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5717acc1-d5f0-4013-b056-915d6f43a1e7(cell1) {{(pid=117994) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 03:57:29.318275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writer thread running {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.321860 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:57:29.323520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:57:29.324362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:57:29.326915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:57:29.328959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Registered counter for database nova_cell0 Jul 07 03:57:29.333455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Registered counter for database nova_cell1 Jul 07 03:57:29.341574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.343013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.350829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.353355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.383806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.context [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5717acc1-d5f0-4013-b056-915d6f43a1e7(cell1) {{(pid=117995) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 03:57:29.387770 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:57:29.389452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:57:29.390286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:57:29.392613 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:57:29.394592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO dbcounter [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Registered counter for database nova_cell0 Jul 07 03:57:29.398675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO dbcounter [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Registered counter for database nova_cell1 Jul 07 03:57:29.410137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_db.sqlalchemy.engines [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.411413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_db.sqlalchemy.engines [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.418239 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writer thread running {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.421010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writer thread running {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.507321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Registered counter for database nova_cell0 Jul 07 03:57:29.514386 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.519103 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.593118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO dbcounter [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Registered counter for database nova_cell0 Jul 07 03:57:29.601339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_db.sqlalchemy.engines [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:57:29.606305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writer thread running {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:57:29.856405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:57:29.864285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:57:29.946747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: WARNING keystonemiddleware.auth_token [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:57:29.954212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: WARNING keystonemiddleware.auth_token [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:57:30.213528 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:57:30.220506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-c43527a2-7bbc-4f87-baeb-8a9786e26a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:57:30.226012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f46b6419c0 pid: 117994 (default app) Jul 07 03:57:30.301911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: WARNING keystonemiddleware.auth_token [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 03:57:30.307925 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: WARNING keystonemiddleware.auth_token [None req-bd222c68-25c9-4ac0-b1ac-73d8cbbcc84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 03:57:30.313781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f46b6419c0 pid: 117995 (default app) Jul 07 03:58:11.872515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:11.873710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:11.875935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:11.878749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:12.998629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2e278f34-5c9b-4e6b-b0f3-e964565f5e5f tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Action: 'create', calling method: .version_select at 0x7ff6575b4550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1285863818", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2e278f34-5c9b-4e6b-b0f3-e964565f5e5f tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 122 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 03:58:13.016817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1285863818", "metadata": {"Type": "work"}}} Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 03:58:13.018303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1285863818', 'metadata': {'Type': 'work'}}}} Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise error Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi '#$%' Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:13.019777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 03:58:13.021321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 03:58:13.022434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 03:58:13.022434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.022434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2e278f34-5c9b-4e6b-b0f3-e964565f5e5f tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:13.022434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2e278f34-5c9b-4e6b-b0f3-e964565f5e5f tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.169038 Jul 07 03:58:13.022434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jul 7 03:58:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 03:58:13.036054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:13.037742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:13.038684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:13.042689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:13.463163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba02b7d7-ed69-428d-9d59-529d4d04a09b tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Action: 'create', calling method: .version_select at 0x7ff6575fa0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1319102352", "metadata": {"Type": "work"}}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba02b7d7-ed69-428d-9d59-529d4d04a09b tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 120 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 03:58:13.468869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1319102352", "metadata": {"Type": "work"}}} Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: Jul 07 03:58:13.470327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1319102352', 'metadata': {'Type': 'work'}}}} Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise error Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi '0' Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:13.471078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 03:58:13.472486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 03:58:13.473544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 03:58:13.473544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.473544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba02b7d7-ed69-428d-9d59-529d4d04a09b tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:13.473544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba02b7d7-ed69-428d-9d59-529d4d04a09b tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.443198 Jul 07 03:58:13.475290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jul 7 03:58:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 449 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 03:58:13.480998 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4631c087-6e09-41d0-ab98-03011aaad5f4 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Action: 'create', calling method: .version_select at 0x7ff65753d940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2083859017", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4631c087-6e09-41d0-ab98-03011aaad5f4 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 119 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 03:58:13.483639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2083859017", "metadata": {"Type": "work"}}} Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 03:58:13.485030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2083859017', 'metadata': {'Type': 'work'}}}} Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise error Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi '' Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:13.485859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 03:58:13.487128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 03:58:13.488551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 03:58:13.488551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:13.488551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4631c087-6e09-41d0-ab98-03011aaad5f4 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:13.488551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4631c087-6e09-41d0-ab98-03011aaad5f4 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010335 Jul 07 03:58:13.488551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jul 7 03:58:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 03:58:13.501095 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e8944fc8-d1b6-4319-9d1f-89397a4ebc85 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Calling method '.version_select at 0x7ff6575024c0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:14.114579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-e8944fc8-d1b6-4319-9d1f-89397a4ebc85 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] HTTP exception thrown: Volume tempest-invalid-2111256207 could not be found. Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e8944fc8-d1b6-4319-9d1f-89397a4ebc85 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2111256207 HTTP/1.1 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 03:58:14.120038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Volume tempest-invalid-2111256207 could not be found. Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'tempest-invalid-2111256207'} Jul 07 03:58:14.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2111256207 could not be found. (HTTP 404) (Request-ID: req-e5fa71cd-f979-4fe5-91da-32bc0af3a49c) Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.123061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 03:58:14.124552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2111256207 could not be found. Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:58:14.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2111256207 could not be found. Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2111256207 could not be found. Jul 07 03:58:14.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.130052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e8944fc8-d1b6-4319-9d1f-89397a4ebc85 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 404 to user: Volume tempest-invalid-2111256207 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:14.131163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e8944fc8-d1b6-4319-9d1f-89397a4ebc85 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2111256207" status: 404 len: 99 microversion: 2.1 time: 0.633868 Jul 07 03:58:14.132592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jul 7 03:58:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2111256207 => generated 99 bytes in 636 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 07 03:58:14.144711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fe93ca00-6d60-440e-8f1d-ef190d9816bd tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006210 Jul 07 03:58:14.150607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1139 bytes} [Thu Jul 7 03:58:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 03:58:14.151540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f14070b6-facd-491b-aaa7-c61b5df696d4 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657460e50>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:14.156439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9b5af70d-7d49-4765-8927-1e68c6e4da43 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004720 Jul 07 03:58:14.173068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1136 bytes} [Thu Jul 7 03:58:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 03:58:14.177870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2af1197c-d0c4-41e7-85dc-58f4be4ca538 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Calling method '.version_select at 0x7ff65753d8b0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:14.262664 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f14070b6-facd-491b-aaa7-c61b5df696d4 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4d78f439-5449-4e20-a524-bf9233e32c7a" status: 200 len: 351 microversion: 2.1 time: 0.120001 Jul 07 03:58:14.263742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 03:58:14 2022] GET /compute/v2.1/os-volumes/4d78f439-5449-4e20-a524-bf9233e32c7a => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:58:14.879580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-2af1197c-d0c4-41e7-85dc-58f4be4ca538 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] HTTP exception thrown: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2af1197c-d0c4-41e7-85dc-58f4be4ca538 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/os-volumes/0a7c9f9a-2344-4b96-bde0-a54d9d349a21 HTTP/1.1 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 03:58:14.883517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '0a7c9f9a-2344-4b96-bde0-a54d9d349a21'} Jul 07 03:58:14.884990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. (HTTP 404) (Request-ID: req-30aac701-b070-4283-baba-1ec4835b8d5d) Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.885794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 03:58:14.888183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 03:58:14.890176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2af1197c-d0c4-41e7-85dc-58f4be4ca538 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 404 to user: Volume 0a7c9f9a-2344-4b96-bde0-a54d9d349a21 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2af1197c-d0c4-41e7-85dc-58f4be4ca538 tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/0a7c9f9a-2344-4b96-bde0-a54d9d349a21" status: 404 len: 109 microversion: 2.1 time: 0.711083 Jul 07 03:58:14.893084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 03:58:14 2022] DELETE /compute/v2.1/os-volumes/0a7c9f9a-2344-4b96-bde0-a54d9d349a21 => generated 109 bytes in 712 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 03:58:14.903851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a9ae43f-c45c-482e-bf8a-ee83eaef59bf tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Calling method '.version_select at 0x7ff657480790>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:14.953251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-8a9ae43f-c45c-482e-bf8a-ee83eaef59bf tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] HTTP exception thrown: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a9ae43f-c45c-482e-bf8a-ee83eaef59bf tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Request method failure captured: Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/os-volumes/93bd0d76-8389-47b0-9490-4b2e6b5d1494 HTTP/1.1 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnTNHXZJUPwv4o91M4Ep-Ds98kCxTpx2sLZupiGkS_SUonFJ5ujS8dzHpXoAyn6nQ1WtfGVOPY9UOSMl4ZqRT8-YPI9iSyGbapZTp4czOZoSPuL_IA-JVT3vGqmFbAYQD95TlNbMqepvxf4yJtTq-CycRTkkbXO47-cNywhuaIhQfk Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 03:58:14.957290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25d59983cf24f029934e7488de3a6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a25d59983cf24f029934e7488de3a6d0 Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesNegativeTest-857076683 Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 1c7a337cea3d4dd38095800e80e65047 Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesNegativeTest-857076683-project Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '93bd0d76-8389-47b0-9490-4b2e6b5d1494'} Jul 07 03:58:14.958924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. (HTTP 404) (Request-ID: req-1504a458-b996-4d1d-b3d9-747df692622e) Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.959983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 03:58:14.961962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 03:58:14.963656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a9ae43f-c45c-482e-bf8a-ee83eaef59bf tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] Returning 404 to user: Volume 93bd0d76-8389-47b0-9490-4b2e6b5d1494 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8a9ae43f-c45c-482e-bf8a-ee83eaef59bf tempest-VolumesNegativeTest-857076683 tempest-VolumesNegativeTest-857076683-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93bd0d76-8389-47b0-9490-4b2e6b5d1494" status: 404 len: 109 microversion: 2.1 time: 0.065191 Jul 07 03:58:14.966103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 03:58:14 2022] GET /compute/v2.1/os-volumes/93bd0d76-8389-47b0-9490-4b2e6b5d1494 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 03:58:15.927900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-35eed354-84ee-41aa-859f-73160454de2e tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657cd9160>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:16.011133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-35eed354-84ee-41aa-859f-73160454de2e tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/017b3af5-86c3-4681-b3e0-5db13e3e6b7c" status: 200 len: 351 microversion: 2.1 time: 0.087566 Jul 07 03:58:16.011777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 03:58:15 2022] GET /compute/v2.1/os-volumes/017b3af5-86c3-4681-b3e0-5db13e3e6b7c => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:17.935282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0b4a6b4d-1f2b-4bfd-a88c-77d5d312ad55 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff65740d700>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:18.024174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0b4a6b4d-1f2b-4bfd-a88c-77d5d312ad55 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b6af98f9-a575-4f54-8597-165b38dd2ef1" status: 200 len: 350 microversion: 2.1 time: 0.092882 Jul 07 03:58:18.025050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 03:58:17 2022] GET /compute/v2.1/os-volumes/b6af98f9-a575-4f54-8597-165b38dd2ef1 => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:18.040432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1a4c5c16-fca6-44b7-9a7f-ae0f30fb8240 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657411670>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:18.203181 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1a4c5c16-fca6-44b7-9a7f-ae0f30fb8240 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.168833 Jul 07 03:58:18.204084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1133 bytes} [Thu Jul 7 03:58:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:18.218286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f63b2cc6-eb02-49a1-9b9a-9e2f0bd790e9 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657460940>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:18.449229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f63b2cc6-eb02-49a1-9b9a-9e2f0bd790e9 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.235188 Jul 07 03:58:18.450034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1148 bytes} [Thu Jul 7 03:58:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:18.466586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eeb347c7-3ae2-4993-9e64-8c05ad5d034e tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657414310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:18.821404 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eeb347c7-3ae2-4993-9e64-8c05ad5d034e tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.358485 Jul 07 03:58:18.826022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1133 bytes} [Thu Jul 7 03:58:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:18.842153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-73b62d4a-5dfc-4af2-bc0b-709ab7f76c46 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff65740d790>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:19.103474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-73b62d4a-5dfc-4af2-bc0b-709ab7f76c46 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.268937 Jul 07 03:58:19.112337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1166 bytes} [Thu Jul 7 03:58:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:19.119805 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d6f2cce6-972a-4551-9e6b-1a1641eaebf1 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657414f70>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:19.348177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d6f2cce6-972a-4551-9e6b-1a1641eaebf1 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.231862 Jul 07 03:58:19.349447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Jul 7 03:58:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:19.366323 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-587726b0-f98d-4a55-a25d-6016d7119645 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657413430>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:19.613233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-587726b0-f98d-4a55-a25d-6016d7119645 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.251494 Jul 07 03:58:19.627988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Jul 7 03:58:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:19.631972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d86dbaf0-aaf7-4061-bac7-f5289415c460 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff657414940>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:19.876901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d86dbaf0-aaf7-4061-bac7-f5289415c460 tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.254752 Jul 07 03:58:19.877538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1187 bytes} [Thu Jul 7 03:58:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:58:19.890956 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f36d2748-2e77-420d-a2b5-6c60b25de32d tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] Calling method '.version_select at 0x7ff65740db80>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:20.093349 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f36d2748-2e77-420d-a2b5-6c60b25de32d tempest-VolumesTestJSON-1326338005 tempest-VolumesTestJSON-1326338005-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.206103 Jul 07 03:58:20.094432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Jul 7 03:58:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:27.181497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1514373380", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "networks": [{"uuid": "80b876f1-9d1a-442d-92a7-6938caf94dcb"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:27.421958 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] validate_networks() for [('80b876f1-9d1a-442d-92a7-6938caf94dcb', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:58:29.454706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ce505b35-9e7c-43cf-8e8a-01c7c48f8ff5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: .version_select at 0x7ff6575faee0>, body: {"keypair": {"name": "tempest-keypair-724911667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPQ+6ibjnZLMp8/0T81UqjzDdySQc81hFppK9MFNcnRqcqPMtLh7zYuAODKSHKz6c5fF1Mgk9gkYU1mFID01wGboXyXgwJ4ZojvcNCSslP9ybkshefgN2npHg8G7SpNiQ=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:29.605707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-ce505b35-9e7c-43cf-8e8a-01c7c48f8ff5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:29.640049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-ce505b35-9e7c-43cf-8e8a-01c7c48f8ff5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for user 4562cd7ed5c845ce883667028a42fb3d and project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:29.781809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ce505b35-9e7c-43cf-8e8a-01c7c48f8ff5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632393 Jul 07 03:58:29.788834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 03:58:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:58:29.950122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:58:29.950660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:58:29.954989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:58:29.955408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:58:29.956343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:58:29.982341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:29.982788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:29.988650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:29.989529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:30.077814 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Getting quotas for project 07a5dce1a3c04a14884bb6c2bd94657b. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:30.086767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Getting quotas for user 402f0d0c41974f3088baf22d23dd0a18 and project 07a5dce1a3c04a14884bb6c2bd94657b. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:30.102736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:58:30.107376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:58:30.304060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1cad4f4e-149d-4922-94fc-36a1223410c7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.575707 Jul 07 03:58:30.306597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 11/21] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 03:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 03:58:30.318288 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a213a8c5-cb87-420a-a1b9-e6744a6115b0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:30.319183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a213a8c5-cb87-420a-a1b9-e6744a6115b0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:30.755256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a213a8c5-cb87-420a-a1b9-e6744a6115b0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:30.790769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a213a8c5-cb87-420a-a1b9-e6744a6115b0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1215 microversion: 2.1 time: 0.477061 Jul 07 03:58:30.791360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:30 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1215 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:30.905479 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0634f29c-55d6-4851-a1a8-675d1939e4d5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: .version_select at 0x7ff65731b430>, body: {"keypair": {"name": "tempest-keypair-1588716840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2RnHMRmcavEtSRvNGOBSfX+Y6FRBvI29kbSKRKBU3aA4AGs6orkL/3S1ZeiSj5j5bePsUN5f59NZkLZ+d6nOG2jvN+qlFMxZ29fnUzPzq+rvtwM8OzLChQI0ncvGsReg=="}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:30.977913 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-0634f29c-55d6-4851-a1a8-675d1939e4d5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for project a43d47ba220e4705adeb85c31c6605e1. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:30.987649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-0634f29c-55d6-4851-a1a8-675d1939e4d5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for user a5219f613f5b43d6978f2fe410ce4d4f and project a43d47ba220e4705adeb85c31c6605e1. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:31.103908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0634f29c-55d6-4851-a1a8-675d1939e4d5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.546544 Jul 07 03:58:31.106470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 12/23] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Jul 7 03:58:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 550 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 07 03:58:31.567251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-965382079", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:31.833347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38ecb6a6-ee00-408b-aae1-23b26e6b295c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:31.833977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-38ecb6a6-ee00-408b-aae1-23b26e6b295c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:31.844343 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] validate_networks() for [('0c0310b2-bd36-4c15-b0a3-531585c03410', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:58:32.161242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-38ecb6a6-ee00-408b-aae1-23b26e6b295c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:32.205273 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-38ecb6a6-ee00-408b-aae1-23b26e6b295c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1215 microversion: 2.1 time: 0.395289 Jul 07 03:58:32.218188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:31 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:33.228346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ae4f0730-2e77-4d17-be73-a04f6d89e825 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:33.229389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ae4f0730-2e77-4d17-be73-a04f6d89e825 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:33.774684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ae4f0730-2e77-4d17-be73-a04f6d89e825 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:33.783175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ae4f0730-2e77-4d17-be73-a04f6d89e825 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1215 microversion: 2.1 time: 0.559491 Jul 07 03:58:33.792495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:33 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1215 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:34.718823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:58:34.719406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:58:34.719708 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:58:34.720119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:58:34.720573 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:58:34.758532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:34.759340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:34.763315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:34.765889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:34.809834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:34.810481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:34.821578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:34.821578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:34.824634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:34.825875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:34.857600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:34.867877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for user d8caa40d03dc43acb66dd7d6c128a61b and project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:34.927861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:58:34.940827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:58:35.188583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3f01cdf9-34b9-46a1-962d-5cde83ef9ad2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.224561 Jul 07 03:58:35.194501 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 12/26] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 03:58:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 03:58:35.200890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fcfe0fa3-f11e-40fa-bad7-a45485d26bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:35.203643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fcfe0fa3-f11e-40fa-bad7-a45485d26bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:35.902692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fcfe0fa3-f11e-40fa-bad7-a45485d26bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:35.903196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:35.950267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fcfe0fa3-f11e-40fa-bad7-a45485d26bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1221 microversion: 2.1 time: 0.748176 Jul 07 03:58:35.973479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:35 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1221 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:35.984855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-022b3add-da1c-4966-a133-e28143986dc6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1267 microversion: 2.1 time: 1.178350 Jul 07 03:58:35.987126 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:34 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1267 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:36.137086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-561844756", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:36.303933 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] validate_networks() for [('0c0310b2-bd36-4c15-b0a3-531585c03410', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:58:36.846141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1144269032", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84b0448c-9593-4f3f-a8de-01ac7957c004"}], "security_groups": [{"name": "tempest-securitygroup--1250989692"}], "key_name": "tempest-keypair-724911667", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:37.301133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] validate_networks() for [('84b0448c-9593-4f3f-a8de-01ac7957c004', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:58:38.885590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:58:38.886859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:58:38.887485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:58:38.888345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:58:38.889080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:58:38.913097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:38.914208 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:38.938936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:38.941221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:39.014276 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:39.019310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for user d8caa40d03dc43acb66dd7d6c128a61b and project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:39.042121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:58:39.060129 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:58:39.174535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c18a4247-30af-4671-a41d-cb969be91b12 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.042503 Jul 07 03:58:39.176516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 14/29] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 03:58:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 03:58:39.188114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:39.189365 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:39.200383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:39.201785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:39.205121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:39.206657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:40.059627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:40.448925 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:58:40.449583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:58:40.450069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:58:40.450484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:58:40.450899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:58:40.498468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:40.498980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:40.511583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:40.514652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:40.619305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:40.628416 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:40.665358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for user 4562cd7ed5c845ce883667028a42fb3d and project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:40.672680 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4a30b720-937f-4d76-b9d2-4f610b6f6868 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 1.494755 Jul 07 03:58:40.685143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:39 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:40.730172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-352925586", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1230e41-3120-493a-9865-eaee18c94e3f"}], "security_groups": [{"name": "tempest-securitygroup--1474893134"}], "key_name": "tempest-keypair-1588716840", "user_data": "}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:40.751929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:58:40.767284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:58:41.035873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aaa5e50b-de15-477b-abca-072d7e5588c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.195570 Jul 07 03:58:41.041418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 16/31] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 03:58:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 4202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 03:58:41.052807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:41.063519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:41.086958 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:41.089956 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:41.097505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:41.098539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:42.360806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:42.376698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-98ccdc3a-3272-4860-9637-188ee6628b14 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1217 microversion: 2.1 time: 1.322816 Jul 07 03:58:42.381617 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:41 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1217 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:42.401802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:42.403271 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:42.412203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] validate_networks() for [('c1230e41-3120-493a-9865-eaee18c94e3f', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:58:42.438282 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:42.438810 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:42.439686 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:42.441867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:43.132362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:43.160730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-79586bca-9cf1-4064-93f5-9000e551de69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1241 microversion: 2.1 time: 0.771825 Jul 07 03:58:43.163822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:42 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1241 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:43.177303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:43.179120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:43.207732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:43.209199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:43.212125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:43.214909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:44.794756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:58:44.795930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:58:44.796682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:58:44.797493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:58:44.798459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:58:44.821669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:44.828455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:44.829866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:44.831841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:44.880458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for project a43d47ba220e4705adeb85c31c6605e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:58:44.889140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for user a5219f613f5b43d6978f2fe410ce4d4f and project a43d47ba220e4705adeb85c31c6605e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:58:44.922423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:58:44.925508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:58:45.013603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.030091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-30e22615-ffba-4957-b14c-a9e2e0e0a9c3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.343968 Jul 07 03:58:45.036612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 16/34] 10.222.0.20 () {62 vars in 1187 bytes} [Thu Jul 7 03:58:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 4351 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 03:58:45.047075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:45.051811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8c0b736a-e933-4549-9771-6984d795c28b tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 1.884351 Jul 07 03:58:45.052453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:45.054293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 19/35] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:43 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:45.071428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:45.075409 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:45.098167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.099922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.101696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.105277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.123079 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.124615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.130695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.159347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.392535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.411930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1f6a8a1a-020c-4bd2-bfbe-0629dbbcfaa1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1295 microversion: 2.1 time: 0.353344 Jul 07 03:58:45.417207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 20/36] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:45 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1295 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:45.571734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-e6b05c36-4e8d-45b0-9cf8-34ca68de60dc req-8bf08f4c-517b-4bc6-9bf7-860fb379d753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32ab07d-63ab-4a0a-88b3-be2a32668f28", "tag": "5ed11ff1-e721-490c-8d8c-22e5d1dc29a5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:45.604504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e6b05c36-4e8d-45b0-9cf8-34ca68de60dc req-8bf08f4c-517b-4bc6-9bf7-860fb379d753 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.605574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e6b05c36-4e8d-45b0-9cf8-34ca68de60dc req-8bf08f4c-517b-4bc6-9bf7-860fb379d753 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.657054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-e6b05c36-4e8d-45b0-9cf8-34ca68de60dc req-8bf08f4c-517b-4bc6-9bf7-860fb379d753 service nova] Creating event network-changed:5ed11ff1-e721-490c-8d8c-22e5d1dc29a5 for instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 on hv-cinder-84684 Jul 07 03:58:45.663560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e6b05c36-4e8d-45b0-9cf8-34ca68de60dc req-8bf08f4c-517b-4bc6-9bf7-860fb379d753 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 03:58:45.664920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.668732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.669875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:45.671022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.671949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:45.687466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9770c680-a093-4d68-99dc-4ac3f9705995 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1279 microversion: 2.1 time: 0.647860 Jul 07 03:58:45.687578 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:45 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1279 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:45.701841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.compute.rpcapi [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 03:58:45.703968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] Releasing lock "compute-rpcapi-router" {{(pid=117994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 03:58:45.713241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:45.714152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:45.771069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f00d6166-10dc-4c65-90d2-1a09a4dcf5de None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352154 Jul 07 03:58:45.772046 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 21/38] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:45.934533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.942782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.955886 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:45.957684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a7912220-c092-4757-9eef-72385d7e0df3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1281 microversion: 2.20 time: 0.258182 Jul 07 03:58:45.958478 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 18/39] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:45 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:46.071889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:46.074205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:46.093362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:46.093818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:46.094611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:46.102146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:46.436144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:46.437023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:46.475952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:46.476479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:46.488553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:46.489145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:46.962284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.000318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7e1d6d5f-3484-4eff-9ed1-b3edfb93992a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1295 microversion: 2.1 time: 0.561668 Jul 07 03:58:47.003648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:46 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1295 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:47.034528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:47.035851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:47.050902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:47.054413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:47.056463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:47.058018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:47.150246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.169064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d4d16871-fddf-44bd-ae92-9e9b73912ed6 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 1.101789 Jul 07 03:58:47.174277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:46 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:47.186799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:47.189387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:47.201508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:47.202217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:47.203347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:47.203944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:47.333484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.355068 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6dbffe36-98b2-439b-9069-d95d51a6f90b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1279 microversion: 2.1 time: 0.343892 Jul 07 03:58:47.361703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:47 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1279 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:47.427741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.436892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.438349 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:47.439495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d50b0ef9-31ae-4fc0-86d6-5e009b79a00b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1333 microversion: 2.20 time: 0.262626 Jul 07 03:58:47.447658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 23/43] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:47 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1333 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:48.029539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:48.030886 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:48.050493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:48.050926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:48.058533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:48.059006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:48.193204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:48.196380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:48.210415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:48.214914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:48.215988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:48.216695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:49.476379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:49.489664 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ae3900a9-8282-4358-9c6c-b36e9d4cd0a8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 1.469225 Jul 07 03:58:49.506706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:48 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:49.509624 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:49.519524 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:49.532672 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:49.534524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3c75b4b4-ef35-476e-baed-8d552faef5af tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 1.350019 Jul 07 03:58:49.551475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:48 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:49.558240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:49.558698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:49.559210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:49.560009 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:49.565657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:49.566116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:49.566937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:49.567858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:49.568754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:49.569341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:50.031203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:50.055405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:50.063463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:50.069905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8763762e-c9c9-4a43-9c01-32fbf1d5d175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1339 microversion: 2.20 time: 0.515406 Jul 07 03:58:50.079007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:49 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1339 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:50.511453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:50.513365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:50.530519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:50.531186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:50.532135 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:50.532752 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:50.715719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=20 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:51.252442 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:51.272241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8533f12d-dafb-4e54-9035-682aba8c530f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 1.764113 Jul 07 03:58:51.273018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 22/47] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:49 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:51.278698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:51.279653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:51.287037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:51.287593 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:51.290135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:51.290779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:51.979058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.007881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ee95bfa-c13e-420c-a96d-947e7805c6b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 1.500815 Jul 07 03:58:52.017556 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:50 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:52.037087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-152d1816-c5a5-42b7-88d6-e3b18886d72e req-1e428d09-ff44-435f-a7e4-ce3399239a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a0e9ce-7bb6-48e1-91d6-c339089593b5", "tag": "fd4c0db4-506e-4b87-a7dc-fb151a54c015"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:52.083957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-152d1816-c5a5-42b7-88d6-e3b18886d72e req-1e428d09-ff44-435f-a7e4-ce3399239a7e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.084448 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-152d1816-c5a5-42b7-88d6-e3b18886d72e req-1e428d09-ff44-435f-a7e4-ce3399239a7e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.127211 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.142415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e938a690-1acf-4b9d-a24d-b588e5a30573 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.867917 Jul 07 03:58:52.143198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-152d1816-c5a5-42b7-88d6-e3b18886d72e req-1e428d09-ff44-435f-a7e4-ce3399239a7e service nova] Creating event network-changed:fd4c0db4-506e-4b87-a7dc-fb151a54c015 for instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 on hv-cinder-84684 Jul 07 03:58:52.143637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 23/49] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:51 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:52.148714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:52.154987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:52.156807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-152d1816-c5a5-42b7-88d6-e3b18886d72e req-1e428d09-ff44-435f-a7e4-ce3399239a7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135892 Jul 07 03:58:52.159272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 27/50] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:52.164216 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.164780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.166140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.172623 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.296207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:52.297008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:52.330072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.331469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.332756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.333463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.347463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.371492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.375706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.377138 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-44e18fcb-8b57-4c0d-b6ef-4c48d03cc896 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1339 microversion: 2.20 time: 0.232118 Jul 07 03:58:52.379836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 24/51] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:52 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:52.630125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-8f14df59-fac1-4dd4-9625-69feb7f7ca9d req-1a5d258f-14a7-43a4-8af5-a7b5c2a63ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a", "tag": "0fdd7d34-50db-4d68-a4a1-6a2daac09518"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:52.642118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-8f14df59-fac1-4dd4-9625-69feb7f7ca9d req-1a5d258f-14a7-43a4-8af5-a7b5c2a63ba7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.642822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-8f14df59-fac1-4dd4-9625-69feb7f7ca9d req-1a5d258f-14a7-43a4-8af5-a7b5c2a63ba7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.665323 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-8f14df59-fac1-4dd4-9625-69feb7f7ca9d req-1a5d258f-14a7-43a4-8af5-a7b5c2a63ba7 service nova] Creating event network-changed:0fdd7d34-50db-4d68-a4a1-6a2daac09518 for instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a on hv-cinder-84684 Jul 07 03:58:52.666441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-8f14df59-fac1-4dd4-9625-69feb7f7ca9d req-1a5d258f-14a7-43a4-8af5-a7b5c2a63ba7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 03:58:52.668010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.668815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.669512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:52.670162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:52.670794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:52.682707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.compute.rpcapi [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 03:58:52.683880 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] Releasing lock "compute-rpcapi-router" {{(pid=117995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 03:58:52.685192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4b2cbd35-f7ec-4260-b19e-02177ec76c3c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.398261 Jul 07 03:58:52.686750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:52 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:52.709907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-16a40ecc-360d-4cf9-a3f2-749856802048 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212020 Jul 07 03:58:52.712391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 25/53] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:58:53.024662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:53.025264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:53.032257 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.032944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.034001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.034626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.162089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:53.163015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:53.175606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.176071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.183499 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.184016 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.315637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.331416 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-863b5106-b843-419f-8fcc-a889c70ebf52 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.309137 Jul 07 03:58:53.333379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 29/54] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:53 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:53.403402 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.407581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:53.408246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:53.418688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e84f6647-182d-4309-a21e-42eb1bf4550c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.260723 Jul 07 03:58:53.421324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.421864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.424499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.424943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.433355 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:53 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:53.585696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.595828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.597695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.599114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ae0786f-9f52-4e4e-a8c9-22cde3d9578a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.203541 Jul 07 03:58:53.600351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 30/56] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:53 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:53.704530 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:53.705301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:53.713713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.714162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.715097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:53.715537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:53.868436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:53.877040 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8424b500-eaa3-4614-ab27-5ed8c89ddc92 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.176411 Jul 07 03:58:53.877901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 27/57] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:53 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:54.193959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-9736a069-a0b2-44c6-9087-b23e3b0a1ef9 req-16f03904-8da6-477c-b60e-52b78b35347a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf125a4-168a-440b-ac01-25e63c8b28c2", "tag": "c39a5330-23dc-4933-bff6-af9149f63583"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:54.204349 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9736a069-a0b2-44c6-9087-b23e3b0a1ef9 req-16f03904-8da6-477c-b60e-52b78b35347a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.204989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9736a069-a0b2-44c6-9087-b23e3b0a1ef9 req-16f03904-8da6-477c-b60e-52b78b35347a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.219395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-9736a069-a0b2-44c6-9087-b23e3b0a1ef9 req-16f03904-8da6-477c-b60e-52b78b35347a service nova] Creating event network-changed:c39a5330-23dc-4933-bff6-af9149f63583 for instance eaf125a4-168a-440b-ac01-25e63c8b28c2 on hv-cinder-84684 Jul 07 03:58:54.227640 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-9736a069-a0b2-44c6-9087-b23e3b0a1ef9 req-16f03904-8da6-477c-b60e-52b78b35347a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038520 Jul 07 03:58:54.228957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 31/58] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:54.348945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:54.349843 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:54.360106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.360591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.364162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.365216 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.437839 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:54.438543 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:54.446540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.447143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.447988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.448459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.659670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:54.663807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:54.669646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5dbf417c-4f8a-4e88-93e5-4eea64288214 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.324602 Jul 07 03:58:54.670298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:54 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:54.674950 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0f78abca-a575-4fbe-b02e-b46f42a9d15e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.239552 Jul 07 03:58:54.676059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:54.676710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:54.684371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 32/60] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:54 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:54.688655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:54.693021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.694020 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.695356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.696073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.894546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:54.895162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:54.902125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.902663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.902939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:54.903553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:54.904054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:54.913469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:54.916319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:54.918231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c8bc4a98-7feb-421a-8618-19ade9bf07d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.246641 Jul 07 03:58:54.929583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:54 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:54.932093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:55.061216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:55.070319 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec749feb-3479-4f0a-9ad5-d8858bb8c1c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.179548 Jul 07 03:58:55.080864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 33/62] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:54 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:55.688339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:55.689772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:55.695932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:55.696456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.696568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:55.696777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:55.698364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.698824 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:55.699604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:55.705321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.705806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:55.706763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.707332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:55.899698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:55.911295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-17165976-530c-4737-bbf5-19d8037999a5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.227372 Jul 07 03:58:55.912166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:55 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:55.929297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:55.937987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:55.938524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d3dc9783-34ca-474b-a278-7849385cb355 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.248217 Jul 07 03:58:55.939178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:55 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:55.939980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:55.942153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=28 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:55.948898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.951365 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:55.952157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:55.952621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.089718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:56.090336 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:56.099573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.100050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.100883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.101330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.186364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:56.210116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:56.212089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:56.213833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b4b3aa51-c4e1-4353-9293-d034665f9c76 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.279921 Jul 07 03:58:56.216757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 31/65] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:55 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:56.781789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:56.791128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-96cf458f-b659-4521-85ef-d8b4f9606be5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.705945 Jul 07 03:58:56.792383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:56 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:56.930568 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:56.932488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:56.938702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.939150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.940006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.940626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.956346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:56.957246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:56.963807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:56.966380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.966997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:56.968142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:56.968781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.238527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.242156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:57.245937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.251086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b16a9ac4-f8e5-475f-b0e0-09b61cbcee55 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.325979 Jul 07 03:58:57.252544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:56 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:57.258580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:57.259193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:57.265056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ff551d80-cae4-4656-99cc-efbad6d6bebf tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.312412 Jul 07 03:58:57.267074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:57.267397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.268170 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:57.268640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.278144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:56 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:57.317996 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-38239a03-6100-4ae4-a9f7-1292642016b9 req-f42a5720-e68d-42c2-a724-61d9392a8b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:58:57.327106 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-38239a03-6100-4ae4-a9f7-1292642016b9 req-f42a5720-e68d-42c2-a724-61d9392a8b7d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:57.327664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-38239a03-6100-4ae4-a9f7-1292642016b9 req-f42a5720-e68d-42c2-a724-61d9392a8b7d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.344013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-38239a03-6100-4ae4-a9f7-1292642016b9 req-f42a5720-e68d-42c2-a724-61d9392a8b7d service nova] Creating event network-changed:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 03:58:57.349383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-38239a03-6100-4ae4-a9f7-1292642016b9 req-f42a5720-e68d-42c2-a724-61d9392a8b7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035036 Jul 07 03:58:57.350070 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 37/69] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:58:57.428926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.437324 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.438857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.439988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-89f14d08-0b3e-49c6-b3ba-f711385df300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.186102 Jul 07 03:58:57.440609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 33/70] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:57 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:57.809153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:57.810082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:57.819697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:57.820284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.821064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:57.821685 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:57.962203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:57.971083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-84f2d357-dec6-4601-91fd-c42cb5116382 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.166189 Jul 07 03:58:57.971647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 38/71] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:57 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:58.268971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:58.269594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:58.276956 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.277366 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.278226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.278711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.289674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:58.290290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:58.296208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.296685 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.297442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.298290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.471540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:58.479080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9a5de147-f9bc-476f-8041-11f86c6ae1b9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.213933 Jul 07 03:58:58.479224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:58.479652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 34/72] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:58 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:58.484923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:58.485598 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:58.487394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f37a174d-3094-4609-93db-a8f974ac0122 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.201568 Jul 07 03:58:58.487964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:58 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:58:58.491549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.492052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.492906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.493335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.624140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:58.632200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:58.633714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:58.635006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba918d66-9a80-4e1d-ae25-580e1b49f93e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.153662 Jul 07 03:58:58.635577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 35/74] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:58 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:58:58.989844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:58.990454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:58.996725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.997169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:58.997929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:58.998365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.137511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.145302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec0465be-9a3b-4e46-a3d8-d5fb8cf00eb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.159292 Jul 07 03:58:59.145868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:58 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:59.496085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:59.496744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:59.505053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.505580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.506251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.506741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.507221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:59.507996 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:59.515770 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.516408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.517173 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.517609 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.726340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.728986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.737922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1bd18b11-1474-41d5-b1ba-b408b00a1e4c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.236393 Jul 07 03:58:59.738594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 41/76] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:59 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:59.739636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cf9e9680-fa74-4c70-bb8f-eb9e69930889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.247663 Jul 07 03:58:59.743702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:58:59.744430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:58:59.750589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.751042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.751795 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:58:59.752417 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:58:59.752668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 36/77] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:58:59 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:58:59.898768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.907736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.909290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:58:59.910398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e72ab261-50db-4cff-95eb-f211e2e599f9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.170825 Jul 07 03:58:59.910966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 42/78] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:58:59 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:00.162400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:00.163256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:00.169624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.170074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.170827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.171263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.297953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:00.305222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a6adb04c-06ed-4687-bc93-810dc946a17c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.146914 Jul 07 03:59:00.305787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 37/79] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:00 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:00.754430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:00.755045 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:00.758621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:00.759846 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:00.761681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.762122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.762877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.763303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.765737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.766183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.766938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.767378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.961322 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:00.965579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:00.968835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dd05d03f-7961-42ea-a298-ea5b4fd0c4e1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.218318 Jul 07 03:59:00.969411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 43/80] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:00 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:00.973345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cd18df69-9c1c-4310-b7b5-d3e0a4b30e42 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.218473 Jul 07 03:59:00.973769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:00.974274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 38/81] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:00 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:00.974375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:00.980397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.980839 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:00.981590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:00.982017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.114730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:01.123400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:01.125298 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:01.126401 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0a02a9ff-d8ca-4857-bf31-e9c86a63c02e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.156086 Jul 07 03:59:01.126953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 44/82] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:00 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:01.323288 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:01.323900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:01.329950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.330393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.331143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.331579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.457163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:01.465138 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2c43e6f5-c4a0-4ff9-8672-1274147a41b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.146312 Jul 07 03:59:01.465715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 39/83] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:01 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:01.984755 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:01.985370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:01.989650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:01.990269 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:01.991296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.991751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.992537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.992972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.997450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.997902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:01.998679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:01.999121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:02.195142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.198369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.203397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4e0dcd18-9d4a-49a4-8a0a-c863b9f8cb90 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.222327 Jul 07 03:59:02.203974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 45/84] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:01 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:02.206213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-02ea8162-1fd1-4098-b7a9-f1c5625b894b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.220321 Jul 07 03:59:02.208711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:02.209317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:02.215947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:02.216257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 40/85] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:01 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:02.216424 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:02.217170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:02.217606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:02.343629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.351309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.353303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.354399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3fd778ca-d9d9-46f9-8362-28b50bde9b10 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.149312 Jul 07 03:59:02.354956 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 46/86] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:02 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:02.483314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:02.483922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:02.489885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:02.490349 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:02.491096 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:02.491523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:02.619815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:02.627496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4e401176-8513-4ccb-aa1d-6a9694bdec2f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.148031 Jul 07 03:59:02.628064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 41/87] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:02 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:03.222870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:03.223475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:03.223870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:03.224112 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:03.225413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=8 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:03.232510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.233034 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.233897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.234380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.236392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.236837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.237712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.238182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.580984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.587575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.588540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2e9b90e8-890b-4302-8bf3-fd198319b34c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.369361 Jul 07 03:59:03.589110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 47/88] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:03 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:03.593656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:03.594264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:03.595861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-348c8960-59d8-406e-88b6-254af7bc7a5f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.376803 Jul 07 03:59:03.596450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 42/89] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:03 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:03.600426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.601074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.602164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.602658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.643838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:03.644490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:03.650448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.650877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.651635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:03.652067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:03.786604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.795198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.796830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.798041 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c29f147-4199-400a-804e-87f70655ab17 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.208016 Jul 07 03:59:03.798607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 48/90] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:03 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:03.808656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:03.816136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-028834b8-9103-4ec7-9850-b5de0a53a772 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.176084 Jul 07 03:59:03.816727 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 43/91] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:03 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:04.606611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:04.609568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:04.613720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:04.614170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:04.614935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:04.615625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:04.616977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:04.619505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:04.626446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:04.627285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:04.628922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:04.629633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:04.983239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:04.990773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4d542772-81c0-4c61-a300-b374194846ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.389292 Jul 07 03:59:04.991344 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:04 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:04.997216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:04.997826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:05.002994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:05.004046 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:05.004544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:05.005318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:05.005800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:05.014384 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f217f38a-6c7a-4e92-a306-17b8e2cc069f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.402590 Jul 07 03:59:05.015670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 44/93] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:04 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:05.023026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:05.024515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:05.044635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:05.045378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:05.046080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:05.046656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:05.241912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:05.246600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:05.254957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:05.256490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:05.264525 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5448cb03-de65-4a33-9ba7-85d68a800d70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.265168 Jul 07 03:59:05.265133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 50/94] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:04 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:05.282769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:05.291630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d85c4baf-31e9-4790-8e8e-7384e7bcfaf0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.274514 Jul 07 03:59:05.292225 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 45/95] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:05 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:06.008573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:06.009734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:06.015587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.016028 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.016981 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.017411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.032998 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:06.033711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:06.040264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.040678 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.041467 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.041902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.235742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.239980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.245778 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-59f3a36b-a3df-4798-9e27-0b449e69d8ef tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.241060 Jul 07 03:59:06.248037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 51/96] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:06 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:06.250411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-32884aed-d877-43c8-98b5-1eafd384d4dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.222178 Jul 07 03:59:06.251250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 46/97] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:06 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:06.283639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:06.284292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:06.291137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.291638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.292453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.292884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.308810 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:06.312945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:06.318927 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.319380 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.320140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:06.320604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:06.501278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.504687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.510534 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.512107 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:06.513350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8355d2b2-fb06-4df7-bcd6-f544a7e3bb84 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.234151 Jul 07 03:59:06.513870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bc50eb28-9e5f-45e1-ac90-75102b33cb7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.208866 Jul 07 03:59:06.514255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 52/98] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:06 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:06.523140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:06 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:07.266828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:07.267546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:07.276174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:07.276873 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:07.283536 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.283992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.284798 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.285238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.291641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.292089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.292895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.293335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.508697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.517004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.517515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9d52582f-d180-491f-aac0-d181a5293290 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.253956 Jul 07 03:59:07.518239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 53/100] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:07 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:07.531916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:07.532693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:07.537225 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a0e70503-a543-4aa8-92d2-fb914c9e8fb5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.265481 Jul 07 03:59:07.538829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.539099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 48/101] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:07 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:07.539611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.541364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.541914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.553026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:07.553903 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:07.560096 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.560768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.561719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:07.562314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:07.582342 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:07.819768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.831209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.842525 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-71a6e919-f5f6-48b9-8e7e-495ebdcb155f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.315114 Jul 07 03:59:07.843431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 54/102] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:07 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:07.844567 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.846490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:07.847713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6a02568a-899b-4a00-9207-1d16b87fe69b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.298459 Jul 07 03:59:07.848508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 49/103] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:07 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:08.535265 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:08.536063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:08.542972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.543424 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.544190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.544662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.557107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:08.557890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:08.566984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.567729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.568772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.569959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.738630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:08.753068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b73fdc24-97b9-48f0-acf6-a5d1eb8a64c2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.221508 Jul 07 03:59:08.754787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 55/104] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:08 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:08.778469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:08.800767 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7c46a408-063c-4477-ba49-18f4806b6728 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.248728 Jul 07 03:59:08.810950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 50/105] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:08 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:08.867482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:08.868991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:08.870399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:08.873198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:08.895960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.896597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.897505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.898474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.901021 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.903395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:08.908132 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:08.909044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:09.460482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:09.472196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:09.478217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:09.479926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f4459e6f-8dc3-45fc-bc9e-b37f9fb5642b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.617250 Jul 07 03:59:09.480786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 51/106] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:08 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:09.543693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:09.554850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e651dd33-2164-4bb0-86c9-92b91bf02ef4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.698590 Jul 07 03:59:09.556086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 56/107] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:08 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:09.770981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:09.771603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:09.778805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:09.779254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:09.780019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:09.780533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:09.818121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:09.818734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:09.826285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:09.826739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:09.827514 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:09.827983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:09.967169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:09.974564 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8a167823-5de8-4ede-9103-fdc588fe0243 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.207362 Jul 07 03:59:09.975199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:09 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:09.998884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:10.006216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9a362b52-30a0-4f18-b3c0-bfb30cae6748 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.192013 Jul 07 03:59:10.006892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 57/109] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:09 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:10.498176 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:10.498841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:10.504934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.505205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:10.505963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.506392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:10.578440 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:10.589467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:10.589467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.589467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:10.589951 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.590511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:10.708295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:10.717814 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:10.719531 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:10.720743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-72966894-f481-4da8-9d9a-00e18d495b16 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.226315 Jul 07 03:59:10.721767 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 53/110] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:10 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:10.761220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:10.774155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5abc6abd-79a5-479d-8fbe-d98bed04c350 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.203694 Jul 07 03:59:10.775898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 58/111] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:10 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:10.990949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:10.991520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:10.998218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.998677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:10.999435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:10.999871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.024061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:11.024801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:11.030974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.031804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.032185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.032649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.189312 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:11.198272 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-58c6aeca-dff3-4c69-9dc5-6337378451c6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.211188 Jul 07 03:59:11.198989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:10 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:11.214316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:11.221816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-73a86a94-db2a-4b8b-a2c8-1eb0bb8de713 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.201535 Jul 07 03:59:11.222439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:11 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:11.739306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:11.739919 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:11.748532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.749240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.750177 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.762019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.794314 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:11.795124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:11.819256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.819978 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:11.823278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:11.823766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.051542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.064720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.073504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a53665c4-4f7b-4653-8ce1-5ef6e526be1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.284755 Jul 07 03:59:12.074090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 60/114] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:11 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:12.077014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.080078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.082587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d918e9e4-fc3c-4251-90b9-f8e983d1ad0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.347540 Jul 07 03:59:12.088303 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 55/115] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:11 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:12.218882 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:12.220221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:12.232591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:12.235035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.236085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:12.236980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.414115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-2a720afe-bf1f-4278-9adf-ad1020b1e41a req-56470b36-61fd-4153-82de-1b2aead7ae08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ab07d-63ab-4a0a-88b3-be2a32668f28", "name": "network-vif-plugged", "status": "completed", "tag": "5ed11ff1-e721-490c-8d8c-22e5d1dc29a5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:12.425492 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2a720afe-bf1f-4278-9adf-ad1020b1e41a req-56470b36-61fd-4153-82de-1b2aead7ae08 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:12.425938 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2a720afe-bf1f-4278-9adf-ad1020b1e41a req-56470b36-61fd-4153-82de-1b2aead7ae08 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.434571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.445178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-2a720afe-bf1f-4278-9adf-ad1020b1e41a req-56470b36-61fd-4153-82de-1b2aead7ae08 service nova] Creating event network-vif-plugged:5ed11ff1-e721-490c-8d8c-22e5d1dc29a5 for instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 on hv-cinder-84684 Jul 07 03:59:12.445571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1e50d802-3f6e-42a1-8611-e47a39c3fc96 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.233268 Jul 07 03:59:12.447821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 56/116] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:12 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:12.452075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-2a720afe-bf1f-4278-9adf-ad1020b1e41a req-56470b36-61fd-4153-82de-1b2aead7ae08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373707 Jul 07 03:59:12.457518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 61/117] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:12.461513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:12.465156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:12.474513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:12.475251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.476902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:12.477322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:12.636751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:12.645047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-64fca50b-634e-45b9-9fd4-420f3f0d2a44 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.196082 Jul 07 03:59:12.645930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:12 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:13.102292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:13.105426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:13.105776 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:13.106522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:13.112830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.113334 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.114297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.114736 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.122159 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.122616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.124908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.127176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.464834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:13.471137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:13.473431 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:13.475867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:13.480494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba8c9f66-6013-4d31-aab4-0bcc20c280e2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.381711 Jul 07 03:59:13.491755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 58/119] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:13 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:13.507284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:13.509461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:13.515092 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-60d5963d-1436-404e-b0b9-69abe4476598 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.425041 Jul 07 03:59:13.519088 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 62/120] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:13 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:13.530241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.531145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.532134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.532971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.667871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:13.669062 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:13.683455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.684192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.686278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:13.688213 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:13.834088 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:13.849282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-450cfd1d-90aa-4be8-ad6d-27944979d6dd tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.352093 Jul 07 03:59:13.849866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:13 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:14.084987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:14.094310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-53b95088-7b88-4336-aa23-a36ef3a721a4 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.431957 Jul 07 03:59:14.095411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:13 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:14.499913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:14.500416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:14.508526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.509914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:14.510854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.511567 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:14.534415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:14.537003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:14.551444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.551821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:14.558711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.559219 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:14.799440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:14.807391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:14.808918 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:14.815455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9df1a596-1135-4314-95d5-09d964a1bc64 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.319659 Jul 07 03:59:14.816184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 60/123] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:14 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:14.819758 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:14.828563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2d6d7fc8-ffa3-496c-b3fa-fa3045ac8055 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.299820 Jul 07 03:59:14.829341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 64/124] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:14 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:14.866621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:14.867228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:14.875411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.875861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:14.876651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:14.877079 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.028902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:15.037795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f2636bc2-b133-4436-b6d2-42724c40d111 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.174902 Jul 07 03:59:15.039094 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:14 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:15.117652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:15.118702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:15.125088 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.125846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.126650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.127232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.335194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:15.343987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a002f29d-4ae4-412e-83c1-6d34bb644a5f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.233673 Jul 07 03:59:15.344620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 65/126] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:15 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:15.848579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:15.849599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:15.850004 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:15.850800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:15.863859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.864333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.865103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.865532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.868747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.869303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:15.870214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:15.870784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.141926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.151197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec534d82-cee3-45f4-aa22-e4cd3466a40f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.308570 Jul 07 03:59:16.156704 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:15 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:16.159490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-dc49ed75-3c27-4ed1-89e5-d9ed6e9e04e2 req-fe251516-1763-4685-a1cb-e178c0e5b0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a0e9ce-7bb6-48e1-91d6-c339089593b5", "name": "network-vif-plugged", "status": "completed", "tag": "fd4c0db4-506e-4b87-a7dc-fb151a54c015"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:16.172074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.180607 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.182410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.183499 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-94337b94-70f3-4347-9c95-cdc6add785aa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.353168 Jul 07 03:59:16.184060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 62/128] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:15 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:16.197947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-dc49ed75-3c27-4ed1-89e5-d9ed6e9e04e2 req-fe251516-1763-4685-a1cb-e178c0e5b0d7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:16.198393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-dc49ed75-3c27-4ed1-89e5-d9ed6e9e04e2 req-fe251516-1763-4685-a1cb-e178c0e5b0d7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.203550 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:16.204428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:16.210432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-dc49ed75-3c27-4ed1-89e5-d9ed6e9e04e2 req-fe251516-1763-4685-a1cb-e178c0e5b0d7 service nova] Creating event network-vif-plugged:fd4c0db4-506e-4b87-a7dc-fb151a54c015 for instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 on hv-cinder-84684 Jul 07 03:59:16.211507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:16.213938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.214931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:16.215851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.228852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-dc49ed75-3c27-4ed1-89e5-d9ed6e9e04e2 req-fe251516-1763-4685-a1cb-e178c0e5b0d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072583 Jul 07 03:59:16.229451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 67/129] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:16.362581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:16.363285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:16.372022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:16.372022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.372511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:16.372946 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:16.381292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.396320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1db00617-d0b9-4289-a5b4-42522845dfe3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.197962 Jul 07 03:59:16.397148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 63/130] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:16 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:16.517547 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:16.521112 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:16.525965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f2330481-4b60-4912-9159-20cd012a4fa5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.168193 Jul 07 03:59:16.526484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:16 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:17.168085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:17.168864 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:17.174783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.175234 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.175991 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.176464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.201220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:17.201825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:17.207988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.208460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.209205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.209632 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.396637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.401625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.411170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.412721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.413977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4b3d6e9c-6a63-426a-9ac9-68fbfad5ae7b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.216398 Jul 07 03:59:17.414511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-731022e3-fa8f-4dbb-8203-9e09efb006c1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.250244 Jul 07 03:59:17.414633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 69/132] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:17 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:17.415495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 64/133] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:17 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:17.419500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:17.420398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:17.428328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.428328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.428328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.428683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.543967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:17.544625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:17.551195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.551834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.552633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:17.553071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:17.566309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.574303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8fe43bed-6fd4-4d67-884b-34fada128e7b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.158698 Jul 07 03:59:17.574953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 70/134] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:17 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:17.697078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:17.704456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-67335dfd-041b-40cb-90b3-ebfd5e3d9ca8 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.166252 Jul 07 03:59:17.705026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 65/135] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:17 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:18.436246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:18.441352 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:18.441959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:18.442518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:18.449377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.450097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.451170 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.452473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.454495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.454937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.455891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.456511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.456621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:18.653741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.664168 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-be4468ea-dd64-429c-abba-25a08734ced9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.227041 Jul 07 03:59:18.672882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.676206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:18 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:18.682292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:18.683504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:18.683744 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.690687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.691420 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.692580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.693330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.697704 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.699083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-db6b7107-e16d-4034-936d-a462d969b299 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.266650 Jul 07 03:59:18.699651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 71/137] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:18 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:18.721775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:18.722389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:18.730542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.730914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.732068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:18.733025 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:18.990466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.995172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:18.999957 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6f92a7d0-3461-4ef8-8003-51fd7bced092 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.322266 Jul 07 03:59:19.000739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:18 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:19.003721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-73a40336-ba86-452f-a7dd-81c27336fc82 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.286180 Jul 07 03:59:19.004642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:18 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:19.682730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:19.683330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:19.689701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:19.690244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:19.691015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:19.691429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:19.719564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:19.720306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:19.732247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:19.732844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:19.733681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:19.734186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:19.881668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:19.890513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3665dbbf-8f08-4df8-8ec5-3529fe2c5651 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.211769 Jul 07 03:59:19.900868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:19 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:19.908395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:19.916812 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:19.918317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:19.919421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3bffbb0e-a781-4dd9-89c4-96295b93b8ff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.204106 Jul 07 03:59:19.920158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 73/141] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:19 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:20.017893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:20.018500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:20.021348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:20.022036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:20.025436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.026134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.026900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.027331 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.029146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.029764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.030527 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.030958 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.229487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:20.235815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:20.237560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2c3f0f97-6cd5-43c0-9c26-71abfc02f047 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.223962 Jul 07 03:59:20.238524 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:20 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:20.245883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b7365757-28d6-4871-9ca2-b101ce3803b7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.228432 Jul 07 03:59:20.246501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:20 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:20.907980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:20.908629 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:20.914596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.915051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.915829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.916252 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.940413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:20.940959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:20.953054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.953054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:20.953054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:20.953054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:21.162158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:21.170037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cc782af5-ac4a-4f44-bc75-92c8b2180cb8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.265715 Jul 07 03:59:21.170623 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 70/144] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:20 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:21.193940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:21.205201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:21.208508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:21.208508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-381050c0-3123-444d-ae26-02f8ef14f370 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.271378 Jul 07 03:59:21.208508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 75/145] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:20 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:21.215737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-492812356", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "networks": [{"uuid": "695d3476-5249-449e-98fa-5dedad501f18"}]}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:21.255986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:21.256659 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:21.262731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:21.263658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:21.263932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:21.264406 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:21.275247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] validate_networks() for [('695d3476-5249-449e-98fa-5dedad501f18', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 03:59:21.729268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:21.740511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d955a010-3027-467e-880d-d4685c62d82f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.487393 Jul 07 03:59:21.742696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 76/146] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:21 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:21.749080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:21.750123 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:21.757857 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:21.761816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:21.763910 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:21.764663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.068961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.079660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a16c8a43-6df5-44fe-8483-a7c95946ceed tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.335445 Jul 07 03:59:22.080697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 77/147] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:21 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:22.085305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-9f3dae8d-0836-4ed2-bebe-27b844b4b792 req-d2fca499-faf2-4c1c-a4c0-faa5fe127c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf125a4-168a-440b-ac01-25e63c8b28c2", "name": "network-vif-plugged", "status": "completed", "tag": "c39a5330-23dc-4933-bff6-af9149f63583"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:22.095565 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9f3dae8d-0836-4ed2-bebe-27b844b4b792 req-d2fca499-faf2-4c1c-a4c0-faa5fe127c7c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.095999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9f3dae8d-0836-4ed2-bebe-27b844b4b792 req-d2fca499-faf2-4c1c-a4c0-faa5fe127c7c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.108464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-9f3dae8d-0836-4ed2-bebe-27b844b4b792 req-d2fca499-faf2-4c1c-a4c0-faa5fe127c7c service nova] Creating event network-vif-plugged:c39a5330-23dc-4933-bff6-af9149f63583 for instance eaf125a4-168a-440b-ac01-25e63c8b28c2 on hv-cinder-84684 Jul 07 03:59:22.114250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-9f3dae8d-0836-4ed2-bebe-27b844b4b792 req-d2fca499-faf2-4c1c-a4c0-faa5fe127c7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Jul 07 03:59:22.118808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 78/148] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:22.153790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 03:59:22.154274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 03:59:22.154866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 03:59:22.155283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 03:59:22.155729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 03:59:22.165780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.166240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.167042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.167477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.189354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Getting quotas for project f2434039fa054907b1f24bd0914bd8a1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 03:59:22.189473 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:22.190131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:22.196662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Getting quotas for user 5e12c4ee289445e3a970c25bdde32e66 and project f2434039fa054907b1f24bd0914bd8a1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 03:59:22.196803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.197146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.201004 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.201444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.209344 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 03:59:22.213104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 03:59:22.268562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4c9aba0c-f9c5-4c59-975c-10cbb60ecbc4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057259 Jul 07 03:59:22.269689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 71/149] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 03:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 03:59:22.276120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:22.277546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:22.285244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:22.288160 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.289373 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.290650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.291385 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.436712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.444320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b5830b8-1348-4f9f-b8bd-be5cbb575e7b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.259192 Jul 07 03:59:22.454506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 79/150] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:22 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:22.457887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-276b48e1-7866-49e4-bb0f-acd281c8d1e2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:22.458540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-276b48e1-7866-49e4-bb0f-acd281c8d1e2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:22.555756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.572035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.580627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.581850 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-847ac76e-3582-432e-b746-0d649e912585 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.310814 Jul 07 03:59:22.582642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 72/151] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:22 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:22.598926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-276b48e1-7866-49e4-bb0f-acd281c8d1e2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.608288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-276b48e1-7866-49e4-bb0f-acd281c8d1e2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1218 microversion: 2.1 time: 0.162430 Jul 07 03:59:22.608944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 80/152] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:22 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:22.759329 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:22.760151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:22.767083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.769869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.770756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:22.771869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:22.930774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:22.938318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-99ab7b22-63dc-41b1-b5cb-48e45542547b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.184147 Jul 07 03:59:22.938985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 73/153] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:22 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:23.096448 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:23.097057 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:23.103631 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.104098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.104882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.105308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.236914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.246698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-86dbba4c-6fc7-4e81-af4f-2427739fb9d3 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.153981 Jul 07 03:59:23.247204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 81/154] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:23 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:23.462042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:23.462838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:23.468885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.469400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.470153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.470600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.598109 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.602147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:23.603117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:23.606352 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-16d66ff2-62fd-4109-bdf3-c8256ed916d9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.148101 Jul 07 03:59:23.607274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 74/155] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:23 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:23.610193 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.610866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.611581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.612015 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.632715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:23.634173 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:23.640682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.641306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.642070 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.642498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.718762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.728399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-55c33f8d-4c35-4da3-9d54-9472250f8033 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.099998 Jul 07 03:59:23.728983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 75/156] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:23 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:23.781904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.790551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.792224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:23.793407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c3c95369-8bf8-464a-ae00-474fec403c8b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.196811 Jul 07 03:59:23.793963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 82/157] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:23 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:23.954655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:23.955263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:23.961298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.961736 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:23.962507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:23.962941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.091966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.099391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-18ad06b1-5443-42cf-91e6-0f049ff0244c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.148515 Jul 07 03:59:24.099954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 76/158] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:23 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:24.262917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:24.263533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:24.269569 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.270016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.270771 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.271206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.403226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.410560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-25a71b2c-f4c6-443c-8dd6-b3fd2eeaea89 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.151479 Jul 07 03:59:24.411124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 83/159] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:24 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:24.623840 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:24.624403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:24.630463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.630906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.631671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.632104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.746877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:24.747496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:24.753624 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.754075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.754835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.755268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.764099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.776423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-149389f6-f4e6-4b18-a397-1b7007e5b5d2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.152709 Jul 07 03:59:24.776423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 77/160] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:24 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:24.811762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:24.812397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:24.818469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.818914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.819676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:24.820108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:24.821344 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.828859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ed073be3-b521-4d61-b258-1655ff49929b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.087614 Jul 07 03:59:24.829420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 84/161] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:24 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:24.946752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.954693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.956388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:24.957506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-004960c8-2be3-490a-a0ea-b2579308bdea tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.149599 Jul 07 03:59:24.958064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 78/162] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:24 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:25.116452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:25.117060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:25.119228 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:25.124458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.124900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.125649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.126075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.255001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:25.262827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-987efb01-f768-4087-8ddf-d55d4398d106 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.150159 Jul 07 03:59:25.263385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 85/163] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:25 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:25.427410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:25.428057 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:25.434497 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.434946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.435697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.436139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.564517 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:25.572171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-858a1adf-6578-451a-a56c-3ec86f8b8ae7 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.148641 Jul 07 03:59:25.572767 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 79/164] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:25 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:25.790391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:25.791196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:25.797787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.798236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.799002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.799430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.846511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:25.847123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:25.863844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.864444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.865406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.865847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.941142 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:25.949503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4d08b13d-ee80-4cd9-9f8d-d09e56cc5c03 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.106395 Jul 07 03:59:25.950283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 80/165] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:25 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:25.964144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:25.971683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ea3dcc5-2e2a-48bf-afe4-fcaf1bbf9b9a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.185523 Jul 07 03:59:25.972258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 86/166] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:25 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:25.977641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:25.978285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:25.984313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.984765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:25.985506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:25.985941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.116397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:26.124985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:26.126474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:26.127603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4cd72652-7b09-45e9-80bd-9184185e8ae8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.154725 Jul 07 03:59:26.128165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 81/167] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:25 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:26.280613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:26.281137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:26.287471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.287911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.288680 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.289109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.294293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:26.419161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:26.426436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9281fb9a-bc11-4706-b59c-8d703ff41693 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.150620 Jul 07 03:59:26.426991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:26 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:26.589182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:26.589867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:26.595922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.596397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.597190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.597621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.740198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:26.748140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bf276fa3-4db3-4001-9feb-204bcb108b0d tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.162965 Jul 07 03:59:26.748763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 82/169] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:26 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:26.967162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:26.967772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:26.973641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.974086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.974864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:26.975289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:26.990706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:26.992000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:26.999225 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.000311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.001691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.002427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.022490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:27.037940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.046212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a1cf6993-9c44-4d7b-8be0-83d7b12d279c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.082784 Jul 07 03:59:27.046980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 88/170] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:26 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:27.145341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:27.146052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:27.156128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.163430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-82c1ba50-0586-4512-ab92-75fd88dc2376 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.177606 Jul 07 03:59:27.176481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.176481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.176481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.176481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.177816 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 83/171] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:26 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:27.321969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.330433 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.332013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.333306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16b0ba44-0d0a-497f-b101-a07eb3ad1731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.191763 Jul 07 03:59:27.334262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 89/172] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:27 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:27.443651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:27.444263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:27.451320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.451766 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.452559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.452995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.580539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.588457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-64ec7f89-ae02-4bb0-bb56-94d22434ed45 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.148925 Jul 07 03:59:27.589029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 84/173] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:27 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:27.765767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:27.766287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:27.772202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.772673 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.773442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:27.773865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:27.903407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:27.910732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e5591b09-74a1-420c-86e9-0e7828aa86a1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.148844 Jul 07 03:59:27.911299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 90/174] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:27 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:28.062631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:28.063240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:28.069256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.069698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.070484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.070963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.134674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.141879 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-54625544-7708-4b56-9470-7fbda39cf3f8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.082997 Jul 07 03:59:28.142441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:28 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:28.187535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:28.188142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:28.194164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.194612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.195361 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.195789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.333505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.342145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8597d7c3-8820-4008-ae97-931ce55efca0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.158554 Jul 07 03:59:28.342705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 91/176] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:28 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:28.352406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:28.353785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:28.359642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.360083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.360869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.361297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.504076 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.512986 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.514489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.515585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d698fe1b-7b1f-4026-9714-49943fb467c7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.167401 Jul 07 03:59:28.516147 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 86/177] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:28 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:28.606125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:28.606817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:28.612610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.613048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.613797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.614225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.793143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:28.800929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c54f465e-566e-44ca-8c19-e8f19755677c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.199652 Jul 07 03:59:28.801508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 92/178] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:28 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:28.927465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:28.928117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:28.934193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.934881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:28.935652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:28.936086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.073498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.080745 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c705a7d6-2972-4343-85bb-aec9ecbfe89f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.157130 Jul 07 03:59:29.081307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:28 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:29.158465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:29.159068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:29.165409 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.165936 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.166605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.167035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.232445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.239746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c57e7e1-d4c1-49e5-8ae5-e27c1db393e8 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.085094 Jul 07 03:59:29.240350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 93/180] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:29 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:29.364876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:29.365710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:29.373729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.374218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.375006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.376059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.469730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-fd1c1d8c-9758-42a6-9683-148f15d033bd req-9d514863-ce26-4449-ae83-c3d282501314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a", "name": "network-vif-plugged", "status": "completed", "tag": "0fdd7d34-50db-4d68-a4a1-6a2daac09518"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:29.486020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fd1c1d8c-9758-42a6-9683-148f15d033bd req-9d514863-ce26-4449-ae83-c3d282501314 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.487224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fd1c1d8c-9758-42a6-9683-148f15d033bd req-9d514863-ce26-4449-ae83-c3d282501314 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.510281 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-fd1c1d8c-9758-42a6-9683-148f15d033bd req-9d514863-ce26-4449-ae83-c3d282501314 service nova] Creating event network-vif-plugged:0fdd7d34-50db-4d68-a4a1-6a2daac09518 for instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a on hv-cinder-84684 Jul 07 03:59:29.516576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-fd1c1d8c-9758-42a6-9683-148f15d033bd req-9d514863-ce26-4449-ae83-c3d282501314 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051502 Jul 07 03:59:29.518357 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 94/181] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 03:59:29.537327 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:29.538058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.538518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:29.547508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2b815285-7213-47fc-a979-321cbb979bc3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.191764 Jul 07 03:59:29.547829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.548510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.548809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:29 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:29.549716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.550306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.691647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.700661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.702146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.703476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-831d05a2-0a73-4931-b677-699ef50de50c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.172835 Jul 07 03:59:29.704214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 95/183] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:29 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:29.817089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:29.817705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:29.823653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.824300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.825054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:29.825507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:29.958615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:29.966179 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7dd86bea-9005-42ac-ad8f-06c8de37d26c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.152884 Jul 07 03:59:29.966745 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 89/184] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:29 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:30.097489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:30.098199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:30.104442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.104887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.105635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.106070 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.239149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.248225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3abf2cf9-3810-4171-8050-e255a2bebbb0 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.154368 Jul 07 03:59:30.248838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 96/185] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:30 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:30.256937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:30.257627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:30.264692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.265139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.265900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.266332 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.328941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.336330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-32b8b197-eeaf-43fd-ad28-5fbc89ab2974 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.083289 Jul 07 03:59:30.346004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 90/186] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:30 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:30.564587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:30.565228 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:30.571082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.571554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.572337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.572769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.710700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.721299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-02eea636-56d9-452c-a1ed-aacd0162d0c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.160426 Jul 07 03:59:30.721645 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:30.731585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 97/187] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:30 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:30.731849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:30.731849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.731849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.731849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.732289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.864503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.873461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.875249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:30.876525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5648963c-2869-4fba-84d9-66c487c7f65c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.159039 Jul 07 03:59:30.877076 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 91/188] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:30 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:30.983519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:30.984239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:30.990167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.990594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:30.991345 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:30.991802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.137914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:31.147432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5271789c-400a-49cf-ac7e-f73c31a716ef tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.166920 Jul 07 03:59:31.148669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 98/189] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:30 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:31.266572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:31.267193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:31.275609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.279662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.279662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.279662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.354212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:31.354850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:31.363725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.364526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.365764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.366468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.467827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:31.476955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-49a93d33-b4e1-4974-8043-62c276ade1ea tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.126668 Jul 07 03:59:31.478204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 99/190] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:31 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:31.498616 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:31.509296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9c1d3945-54a8-4c88-9dbd-3d0c1c9d06b9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.245740 Jul 07 03:59:31.510120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 92/191] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:31 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:31.742038 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:31.742649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:31.749669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.750116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.750885 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.751310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.895835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:31.896923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:31.904381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.904904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.905736 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:31.906243 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:31.920140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:31.927867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7d976573-8c19-4b9e-918f-593c29704906 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.189545 Jul 07 03:59:31.928373 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 100/192] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:31 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:32.061856 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.069683 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.071219 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.072343 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ab93f30e-fc61-4941-bd07-fa11d04fa569 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.181208 Jul 07 03:59:32.072897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 93/193] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:31 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:32.166316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:32.166925 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:32.172941 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.173389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.174145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.174578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.303556 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.311599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0e748f3e-85f6-45ec-b345-cf2fa35a741d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.149669 Jul 07 03:59:32.312163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 101/194] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:32 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:32.496981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:32.497754 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:32.500223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:32.501635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:32.508929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.509445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.510400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.510995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.527798 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:32.528518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:32.534979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.536218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.537840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.538470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.590568 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.600309 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-45d99349-494a-44c6-9e37-c7a17e81317c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.107689 Jul 07 03:59:32.607781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:32.611465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:32 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:32.714819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:32.723549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-853e0798-5629-45cc-aaae-7a18e6a6d768 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.199742 Jul 07 03:59:32.732943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 102/196] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:32 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:32.944572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:32.945192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:32.952250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.952734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:32.953509 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:32.953937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.090488 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:33.091212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:33.098111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.099044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.100445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.100601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.101604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.108898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-024aa8f8-2bba-4be9-9660-d482f5a94ea2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.168135 Jul 07 03:59:33.109475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 95/197] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:32 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:33.240576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.249258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.250846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.252033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7ac81184-04e5-46b7-8b33-533f43abfd27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.165853 Jul 07 03:59:33.252695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 103/198] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:33 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:33.327910 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:33.328553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:33.334475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.334931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.335692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.336131 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.465811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.473192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-895cb2ab-b3e0-4217-b92a-e934bb39daf2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.149045 Jul 07 03:59:33.473757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 96/199] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:33 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:33.618544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:33.619163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:33.625234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.625681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.626433 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.626870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.645005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:33.688307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.695657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-190a4348-ba37-4142-ba54-7bdc8a1993dd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.081222 Jul 07 03:59:33.696817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 104/200] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:33 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:33.740108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:33.740761 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:33.746934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.747383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.748133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:33.748596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:33.878538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:33.886486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4abfaaf2-6819-412d-8dbe-49da72a39dad tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.150350 Jul 07 03:59:33.887062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:33 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:34.126856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:34.127430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:34.133362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.133856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.134602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.135036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.260901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.268235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fc017e3e-7f6f-4998-941c-b971ce2a63aa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.145272 Jul 07 03:59:34.268818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 105/202] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:34 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:34.270231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:34.270841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:34.278285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.278865 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.279861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.280320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.409137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.417173 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.418657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.419739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-825ae765-868f-46f8-b90a-2023baba3075 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.153303 Jul 07 03:59:34.420321 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 98/203] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:34 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:34.490001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:34.490606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:34.496561 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.497002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.497777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.498209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.625089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.632341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d4667afd-a264-477b-93b6-601fa6726f6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.146111 Jul 07 03:59:34.632897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 106/204] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:34 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:34.713479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:34.714087 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:34.721144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.721738 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.722386 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.722813 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.782425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:34.789823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-73e748c1-cbdb-49cf-b3ae-bade674cd892 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.080374 Jul 07 03:59:34.790393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 99/205] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:34 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:34.903402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:34.904060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:34.910209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.910625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:34.911379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:34.911811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.043627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.050905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6357dcef-653f-4a67-bb43-e47a4b577343 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.151838 Jul 07 03:59:35.051512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 107/206] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:34 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:35.284895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:35.285510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:35.292589 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.293043 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.293811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.294258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.300202 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:35.438057 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:35.438853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:35.446123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.447934 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.448494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.449516 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.450196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.455337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c618cd3b-03c9-4591-93b0-16b5b55039ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.174201 Jul 07 03:59:35.455917 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 100/207] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:35 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:35.586986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.594866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.596378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.597554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e25dca99-3e99-4e72-83a6-0e319336961b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.163802 Jul 07 03:59:35.598315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 108/208] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:35 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:35.649013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:35.650188 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:35.656114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.656594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.657356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.658104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.800294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.807187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:35.807800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:35.808310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f65221d6-de97-491a-bf19-8f579436d504 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.163013 Jul 07 03:59:35.809095 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 101/209] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:35 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:35.813868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.814511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.815267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:35.815719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:35.887510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:35.895293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1b9f5739-4ecb-487a-bd56-1929a0c8d750 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1222 microversion: 2.1 time: 0.092338 Jul 07 03:59:35.895987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 109/210] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:35 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:36.066823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:36.067455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:36.073846 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.074305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.075042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.075470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.213428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:36.221050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-14677226-296b-40ed-81bf-b5156d310c3e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.158022 Jul 07 03:59:36.221624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 102/211] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:36 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:36.472794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:36.473403 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:36.481422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.481880 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.482650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.483089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.616698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:36.617382 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:36.626017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.626289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.627264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.627850 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.670400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:36.682585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-19db0632-77a5-4142-a2c2-6f5d99a1323c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.213442 Jul 07 03:59:36.695681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:36 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:36.827515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:36.828163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:36.841171 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.844553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.846657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.847145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.857248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:36.872466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:36.877849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:36.882326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c42fff46-e944-45e1-b91a-3d344e884915 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.269677 Jul 07 03:59:36.888325 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 103/213] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:36 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:36.913610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:36.914712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:36.923645 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.926535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:36.929107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:36.929764 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.013489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:37.020978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-adb3bce9-5b2f-4e3a-b564-42d141f18aca tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1214 microversion: 2.1 time: 0.111952 Jul 07 03:59:37.021566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 104/214] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:36 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:37.082239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:37.092713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2c8bebe3-1eae-499e-b3dd-ea78cf438313 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.271513 Jul 07 03:59:37.093661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:36 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:37.242167 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:37.243751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:37.250630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.251228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.252368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.252839 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.428021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:37.448107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba3a291b-cc6c-46d2-957d-a240d7cb3da1 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.212203 Jul 07 03:59:37.449207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 105/216] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:37 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:37.702831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:37.703444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:37.709579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.710024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.710761 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.711191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.903122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:37.903740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:37.912413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.912866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:37.913638 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:37.914070 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.176001 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.179036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.187870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dfada850-fd2d-4e3b-b7dc-dbf63d314408 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.488742 Jul 07 03:59:38.188535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.189161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 112/217] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:37 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:38.190273 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.191393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fc28e745-2a2f-43a3-8419-ea009b5d8c8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.293020 Jul 07 03:59:38.194488 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:38.195324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:38.202281 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.202435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 106/218] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:37 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:38.203206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.204123 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.204864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.207971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:38.208659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:38.217262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.218579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.219756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.220705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.277830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.287625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b7587079-072a-4ae5-a5a4-09f6f952a73c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1270 microversion: 2.1 time: 0.096999 Jul 07 03:59:38.288198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 113/219] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:38 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:38.298379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-4a6f03fe-0ec8-491b-a646-3a895ec342f2 req-c3d20911-8d6c-4e23-adc8-7e09e66b7e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "name": "network-vif-plugged", "status": "completed", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:38.310684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4a6f03fe-0ec8-491b-a646-3a895ec342f2 req-c3d20911-8d6c-4e23-adc8-7e09e66b7e19 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.311129 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4a6f03fe-0ec8-491b-a646-3a895ec342f2 req-c3d20911-8d6c-4e23-adc8-7e09e66b7e19 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.326350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-4a6f03fe-0ec8-491b-a646-3a895ec342f2 req-c3d20911-8d6c-4e23-adc8-7e09e66b7e19 service nova] Creating event network-vif-plugged:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 03:59:38.332848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-4a6f03fe-0ec8-491b-a646-3a895ec342f2 req-c3d20911-8d6c-4e23-adc8-7e09e66b7e19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039153 Jul 07 03:59:38.333468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 114/220] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:38.409546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.418029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-49b7bf5f-7ff6-483f-b039-66b3c2630b1b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.214432 Jul 07 03:59:38.418610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 107/221] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:38 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:38.466511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:38.467213 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:38.473698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.474143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.474906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:38.475405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:38.636908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:38.644385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d4098b5a-77eb-44e5-ab70-3a4d47043a49 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.182654 Jul 07 03:59:38.644939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 115/222] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:38 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:39.205988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:39.206593 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:39.217774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:39.218389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:39.226782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.228431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.229685 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.230081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.230433 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.230711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.231792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.233067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.464612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.464933 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.472571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5d96b84d-a793-49b3-b512-a4521fc06812 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.270175 Jul 07 03:59:39.473140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 108/223] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:39 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:39.473446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.474979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.476359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a7f53851-c6c4-461e-9069-3972f86c77db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.267737 Jul 07 03:59:39.476906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 116/224] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:39 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:39.481187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:39.482119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:39.485069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:39.486141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:39.489315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.489870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.490729 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.491318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.495561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.496032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.496827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.497292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.591752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.606471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fcd271a8-632d-4785-959f-cf3611b35dbf tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.131872 Jul 07 03:59:39.607049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 109/225] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:39 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:39.662559 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.666672 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:39.667528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:39.673459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-22ada7fd-80de-43b4-9cf5-4bd36f50d9a4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.195395 Jul 07 03:59:39.674173 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.674387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 117/226] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:39 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:39.680421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.680421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:39.680421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:39.832777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:39.840953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f907b8ca-b716-493a-b23d-f64c4efe6143 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.180957 Jul 07 03:59:39.841592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 110/227] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:39 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:40.493515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:40.494916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:40.498565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:40.499189 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:40.502233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.502942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.504082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.504869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.506664 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.507298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.522491 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.523625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.736650 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:40.744788 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:40.745430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55a06325-9ede-4696-a8a2-2185e3202b87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.258089 Jul 07 03:59:40.746039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 118/228] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:40 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:40.750921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:40.751556 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:40.754948 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:40.757266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:40.757617 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.758064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.759069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.759333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9c2ff551-6d5a-4058-a03b-1c2243651532 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.264762 Jul 07 03:59:40.759674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.773078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 111/229] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:40 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:40.779809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:40.780694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:40.787116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.787965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.789073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.790505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.845035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:40.865305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-07acbd06-6b1b-4f7c-a187-2053970051c0 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.118110 Jul 07 03:59:40.865892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 119/230] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:40 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:40.878540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:40.879153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:40.889596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.890160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:40.890933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:40.891391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:41.010564 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:41.020695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-63fb4e53-d340-41af-94bc-1644af766f69 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.244073 Jul 07 03:59:41.024213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 112/231] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:40 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:41.084043 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:41.099018 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-98c42f39-3ff0-4780-b406-2c4d445a4274 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.223684 Jul 07 03:59:41.099747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 120/232] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:40 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:41.764563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:41.765175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:41.771868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:41.772440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:41.773213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:41.773642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:41.781630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:41.782751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:41.791827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:41.792825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:41.793862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:41.794746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.021790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.025803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.026687 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:42.033338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.034547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a2e76eab-37d4-4206-962f-69296cbdfff2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.276050 Jul 07 03:59:42.035118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 113/233] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:41 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:42.035556 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.036872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-372372a2-8ab9-4b4f-89c1-420c016a2087 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.259874 Jul 07 03:59:42.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 121/234] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:41 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:42.040944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:42.041560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:42.043244 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:42.043985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:42.047706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.048186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.049163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.049596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.050754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.051285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.052055 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.052522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.150989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.160082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-06d7d4ba-228b-4bc0-a8b2-277e11ed1f92 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.123812 Jul 07 03:59:42.161584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 114/235] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:42 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:42.177181 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:42.177905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:42.187175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.187842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.188952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:42.190444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:42.224914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.234415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e4752d67-7b1b-4542-8447-5343020eb115 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.195615 Jul 07 03:59:42.235664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 122/236] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:42 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:42.346485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:42.358015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8a9ce0cf-6c39-4002-8883-e565649ed464 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.185514 Jul 07 03:59:42.358771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 115/237] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:42 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:43.052848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:43.054220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:43.062906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:43.063507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:43.070270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.071964 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.073094 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.073932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.074405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.074735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.075180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.075711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.323575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.324391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.327251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:43.332175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.333792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.335001 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f29ba15-01d1-48ea-b3d3-f7e4c52f1654 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.276152 Jul 07 03:59:43.335637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 116/238] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:43 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:43.336059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-84e474b9-4ddd-4cf7-9630-2bbb19bdf8b4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.287945 Jul 07 03:59:43.338187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 123/239] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:43 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:43.340407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:43.341241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:43.348300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.348953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.349799 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.350307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.350756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:43.352495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:43.361998 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.362442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.363208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.363662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.424008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.431416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0bac042c-66f5-41b7-9392-5e4e2f20312b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.094537 Jul 07 03:59:43.431983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 117/240] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:43 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:43.436452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:43.437048 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:43.442748 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.443190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.443943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:43.444414 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:43.553174 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.561642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e8fa3e14-20c4-42a1-a337-281ae5ddb07a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.222233 Jul 07 03:59:43.562222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 124/241] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:43 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:43.596313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:43.604087 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-02c7d0c2-21d6-421e-8f0d-69b3dab5a4a2 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.171149 Jul 07 03:59:43.604673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 118/242] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:43 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:44.355120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:44.355684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:44.356021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:44.356125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:44.363461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.363693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.363949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.364157 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.364846 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.365095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.365264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.365539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.564474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.570629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.572921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2fa0100c-d70e-4dd4-8230-9b136761fa45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.221659 Jul 07 03:59:44.574709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 119/243] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:44 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:44.579954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.581835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.584908 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:44.584998 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3882bbe1-4f33-4f05-82c4-a8c2891dbc5e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.232449 Jul 07 03:59:44.585074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:44.585155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 125/244] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:44 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:44.589189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:44.589819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:44.591117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.591633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.592429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.592862 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.595988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.596531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.597314 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.597742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.661423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.669917 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ee7fd14f-d627-41fe-af45-ccb13d88386a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.092209 Jul 07 03:59:44.670488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 120/245] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:44 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:44.682129 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:44.682742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:44.688631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.689081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.689838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:44.690270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:44.781255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.788557 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f468ba93-3c61-4110-9116-2a2e2fec8446 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.204084 Jul 07 03:59:44.789121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 126/246] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:44 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:44.834812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:44.842432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9f29ec56-c890-4ced-a582-68cdbfe1a157 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.164192 Jul 07 03:59:44.842999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 121/247] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:44 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:45.590140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:45.590751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:45.597058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.597501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.598258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.598687 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.602199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:45.602820 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:45.605888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:45.609943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.610390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.611416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.611850 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.809936 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:45.810112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:45.818356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:45.819865 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:45.821493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c26b8ccf-8236-4652-adc7-916feb2f8e18 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.235735 Jul 07 03:59:45.821672 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8abf7bc9-3acf-4a6b-ba65-bb2c23510045 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.224471 Jul 07 03:59:45.822655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 122/249] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:45 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:45.827717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:45.828571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:45.832526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 127/248] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:45 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:45.834826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.835282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.837026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.837481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.837879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:45.838496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:45.844666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.845106 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.845862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.846286 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.924701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:45.933106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba73be36-e654-41ea-b728-e35818a32185 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1278 microversion: 2.1 time: 0.109027 Jul 07 03:59:45.933763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 123/250] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:45 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:45.938890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:45.939509 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:45.946438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.946892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:45.947651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:45.948091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:46.002970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:46.010997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a6655f67-469f-4b25-a65b-0c8bd9e5f13f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1363 microversion: 2.1 time: 0.177433 Jul 07 03:59:46.011569 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 128/251] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:45 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:46.084488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:46.092358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-88fc6ea7-91db-43aa-96dc-565694e8ca2c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1315 microversion: 2.1 time: 0.157576 Jul 07 03:59:46.092936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 124/252] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:45 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:46.839737 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:46.840374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:46.840697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:46.841606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:46.849433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:46.850121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:46.851505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:46.852104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:46.857324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:46.858488 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:46.860171 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:46.860655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.081563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.090335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.093067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.094777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.096217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-28ae7aa2-58c7-4729-8016-1e7e581493b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.260293 Jul 07 03:59:47.097133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 125/253] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:46 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:47.103084 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:47.104851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:47.111574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2bfa9cae-fee3-48c5-ae99-3a5d3690b3b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.276991 Jul 07 03:59:47.112671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.121607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 129/254] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:46 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:47.127907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:47.128804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:47.136752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.138248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.139020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.140462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.141821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.141941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.143148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.286051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.299918 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8459cbe9-4207-4d76-9cf1-811333b553aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1288 microversion: 2.1 time: 0.201345 Jul 07 03:59:47.301614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:47 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:47.315882 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:47.316851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:47.331268 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.332082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.333078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.333742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.435380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.443495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2d986d90-bd39-43bd-8e4f-f40ba8779348 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1549 microversion: 2.1 time: 0.320256 Jul 07 03:59:47.444403 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 130/256] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:47 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:47.468194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:47.469574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:47.477872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.478585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.479356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:47.479794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:47.534564 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:47.542727 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-200ace1f-6f7b-4493-9720-fcfb42ccb61c tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1502 microversion: 2.1 time: 0.238988 Jul 07 03:59:47.543501 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 127/257] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:47 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:47.634736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e7c40766-c4c3-493d-98dd-7d8a998eed3a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175490 Jul 07 03:59:47.635332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 03:59:47 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:48.115013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:48.115609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:48.122631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.123077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.123925 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.124394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.131147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:48.132669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:48.144785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.145140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.145923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.146509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.652645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:48.659906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8f6eb987-ad2e-4ed6-a4a0-1ad23bda4ef8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.534633 Jul 07 03:59:48.660517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:48 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:48.664862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:48.665459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:48.671217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.671662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.672461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:48.672614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:48.672906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:48.682317 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:48.683993 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:48.685298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-38b6c9e6-8548-46f9-bd80-546808f87315 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.574182 Jul 07 03:59:48.686248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 128/260] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:48 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:48.768554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:48.777287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-69b66c23-a91a-4764-9ecd-9b76f2b36d44 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1276 microversion: 2.1 time: 0.115803 Jul 07 03:59:48.778063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 133/261] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:48 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:49.163002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-edfb0745-a0e4-46d3-94df-d4eb23add662 req-a1b73dbb-9636-4970-84c8-66639f620a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a0e9ce-7bb6-48e1-91d6-c339089593b5", "tag": "fd4c0db4-506e-4b87-a7dc-fb151a54c015"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:49.171138 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-edfb0745-a0e4-46d3-94df-d4eb23add662 req-a1b73dbb-9636-4970-84c8-66639f620a7d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.171577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-edfb0745-a0e4-46d3-94df-d4eb23add662 req-a1b73dbb-9636-4970-84c8-66639f620a7d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.182897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-edfb0745-a0e4-46d3-94df-d4eb23add662 req-a1b73dbb-9636-4970-84c8-66639f620a7d service nova] Creating event network-changed:fd4c0db4-506e-4b87-a7dc-fb151a54c015 for instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 on hv-cinder-84684 Jul 07 03:59:49.187993 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-edfb0745-a0e4-46d3-94df-d4eb23add662 req-a1b73dbb-9636-4970-84c8-66639f620a7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028644 Jul 07 03:59:49.188610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 129/262] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 03:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 03:59:49.676959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:49.677504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:49.683987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.684471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.685226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.685666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.703646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:49.704502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:49.710847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.712042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.712913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.713346 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.916945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:49.919858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:49.927185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-944daa59-f0f6-4292-a99a-7d7a6b0feea5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.254051 Jul 07 03:59:49.927415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:49.927696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:49 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:49.929111 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:49.930812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fa84611f-f65e-49a4-bb7a-81218b784bc8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.231245 Jul 07 03:59:49.932238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:49.933618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:49.938864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:49.941082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.941726 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:49.941927 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 130/264] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:49 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:49.942842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:49.943425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:50.016606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:50.025718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0395891b-bcf5-447d-a130-768da9d5c269 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1276 microversion: 2.1 time: 0.097002 Jul 07 03:59:50.026390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 135/265] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:49 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:50.943218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:50.943768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:50.948774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:50.949394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:50.950032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:50.950505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:50.951275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:50.951711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:50.956603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:50.957426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:50.958208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:50.958852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:51.148069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:51.151979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:51.156688 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:51.158206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:51.159267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f3f228b0-4188-46ba-bca6-2785ea7659d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.219948 Jul 07 03:59:51.159389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-891389d9-df11-4375-b6e2-ca06fdb48524 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.214755 Jul 07 03:59:51.159837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 131/267] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:50 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:51.159973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 136/267] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:50 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:51.164989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:51.165794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:51.171657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:51.172104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:51.172883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:51.173317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:51.236893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:51.244909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1e6bc63a-e18e-4d41-8cc4-bcf5b925b75a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1276 microversion: 2.1 time: 0.083457 Jul 07 03:59:51.245470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 137/268] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:51 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:52.176226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:52.176868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:52.176987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:52.177535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:52.183211 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.183646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.183965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.184430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.184532 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.184862 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.185197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.185637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.378231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:52.381617 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:52.385580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:52.387743 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:52.389276 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:52.390374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-62d6f402-ffd9-4dcd-961b-c6958279d57c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.217279 Jul 07 03:59:52.390935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 138/269] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:52 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:52.393228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-dc24a6e8-c99e-4cf3-be09-86410e75c49a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1321 microversion: 2.1 time: 0.220822 Jul 07 03:59:52.393806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 132/270] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:52 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:52.399105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:52.399815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:52.405825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.406267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.407014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:52.407443 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:52.468365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:52.476647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8a7ddfc4-e740-4969-99c3-0b411b95cc1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1276 microversion: 2.1 time: 0.081207 Jul 07 03:59:52.477111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 139/271] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:52 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:53.408657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:53.409269 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:53.410166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:53.412328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:53.416103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.416579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.417347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.418065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.419249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.419728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.420562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.421308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.633090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:53.636165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:53.640532 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fdedb790-69e5-4b4e-8a9b-e846c594ce4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1514 microversion: 2.1 time: 0.234212 Jul 07 03:59:53.641390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 140/272] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:53 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:53.644648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:53.645642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:53.646240 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:53.646359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:53.647485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-63437a0b-0312-4e3a-8ded-a9618ad17733 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.242769 Jul 07 03:59:53.649121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 133/273] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:53 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 03:59:53.653214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.654000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.655396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.655486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.658869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:53.659835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:53.666473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.666919 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.667676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.668102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.694999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:53.720746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:53.730164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0b17fc7e-5824-43cb-b372-babd4bf32c30 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1276 microversion: 2.1 time: 0.087352 Jul 07 03:59:53.730341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 141/274] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:53 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:53.731554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'flavor' on Instance uuid eaf125a4-168a-440b-ac01-25e63c8b28c2 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 03:59:53.867544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e69e0d7f-0f63-411c-ac70-342f476a2023 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2/action" status: 200 len: 32 microversion: 2.1 time: 0.212517 Jul 07 03:59:53.868140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 134/275] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 03:59:53 2022] POST /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 03:59:53.877011 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:53.877945 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:53.884811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.885187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:53.885942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:53.886373 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.046412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:54.054308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9468113c-cc02-4fe9-8252-1b300678c363 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.181005 Jul 07 03:59:54.054907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 142/276] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:53 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:54.170071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1bb485d-936e-44f7-8b80-389a518201fb"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 03:59:54.171214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:54.177568 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.178008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.178765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.179191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.666234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:54.666848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:54.672869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.673386 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.674149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.674580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.817859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:54.825729 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:54.827414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:54.828543 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-059d149d-ae21-4035-9d21-392a5d16a663 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.166661 Jul 07 03:59:54.829098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 143/277] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:54 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:54.833380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:54.833974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:54.840356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.840806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.841543 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:54.841972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:54.973473 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:54.981293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2f74105f-6006-4715-b6ed-5c02ac5b97bc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.151235 Jul 07 03:59:54.981864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 144/278] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:54 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:55.073633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:55.074308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:55.080233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:55.080923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:55.081974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:55.082628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:55.245951 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:55.253336 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-00cf395f-0ae7-4749-89ce-b677d62b55ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.184423 Jul 07 03:59:55.253891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 145/279] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:55 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:55.849949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:55.850623 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:55.857314 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:55.857839 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:55.858606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:55.859043 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:56.030513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:56.038468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:56.040580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:56.041836 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-098f0cc2-9617-4696-87fd-83faaa61cf31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.195811 Jul 07 03:59:56.042392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 146/280] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:55 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:56.046817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:56.047425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:56.053218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:56.053664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:56.054416 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:56.054847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:56.233954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:56.241760 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0d016183-b9a5-4845-b5cb-a0bbe619c766 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.198091 Jul 07 03:59:56.242187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 147/281] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:56 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:56.271201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:56.271852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:56.277775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:56.278276 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:56.279040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:56.279590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:56.418245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:56.425596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b2cb19a-0b9e-41d0-9afc-068abeaf5fa2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.158194 Jul 07 03:59:56.426159 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 148/282] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:56 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:57.059501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:57.060178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:57.066041 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.066482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.067238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.067670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.202568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:57.211427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:57.213223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:57.214323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4f67f6da-3aad-47ad-a718-266d67fc826e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.159338 Jul 07 03:59:57.214862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 149/283] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:57 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:57.260566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:57.261175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:57.266963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.267407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.268156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.268607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.403997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:57.411744 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b8dd1d7a-c638-4a0a-9abc-dbac4ec8780f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.155598 Jul 07 03:59:57.412451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 150/284] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:57 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:57.443435 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:57.444637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:57.452186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.452461 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.453232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:57.453671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:57.583806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:57.591905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-59ce755a-d559-43bc-9470-e9cb44053e63 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.152311 Jul 07 03:59:57.601742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 151/285] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:57 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 03:59:58.232905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:58.233512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:58.239415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.239867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.240707 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.241290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.581693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:58.591007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:58.592599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:58.593726 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-640003a5-7aaf-4177-985b-a7bcd33b94c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.364623 Jul 07 03:59:58.594316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 152/286] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:58 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:58.598793 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:58.599397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:58.606060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.606505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.607261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.607695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.743854 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:58.751179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6202e9ac-02cb-48fa-ba16-e861339c3556 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.155769 Jul 07 03:59:58.751740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 153/287] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:58 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:58.755992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:58.756615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:58.762756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.763205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.763957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:58.764415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:58.892740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:58.900444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0aa17d69-5caf-47ae-ae6a-ae7a39e4c31d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.147740 Jul 07 03:59:58.901004 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 154/288] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:58 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:59.613715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:59.614358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:59.620987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.621437 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:59.622229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.622667 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:59.641852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:59.753601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:59.762932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:59.764555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:59.765645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4777e89c-1024-4b2d-9036-712c79edc4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.155878 Jul 07 03:59:59.766187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 155/289] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 03:59:59 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 03:59:59.770538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:59.771127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:59.777383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.777821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:59.778589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.779017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:59.918051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 03:59:59.926223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2b85be13-5352-4fc8-aa37-6ad7f928307b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.158964 Jul 07 03:59:59.927052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 156/290] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:59 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 03:59:59.931928 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 03:59:59.932577 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 03:59:59.940991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.941440 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 03:59:59.942220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 03:59:59.942656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:00.077224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:00.084793 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8673902c-a0af-4b4a-8f2f-ea8460521302 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.157033 Jul 07 04:00:00.085355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 157/291] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 03:59:59 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:00.524092 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-9847aac6-31d7-4856-9d97-6f9a8d775d32 req-6c9f5e97-3410-441a-beaf-567ee296ffe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a22e0e-a068-4c2a-921d-4bf6b1821d4f", "tag": "593793dd-f837-4e80-96d0-022a3a027797"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:00.532130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9847aac6-31d7-4856-9d97-6f9a8d775d32 req-6c9f5e97-3410-441a-beaf-567ee296ffe6 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:00.532679 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9847aac6-31d7-4856-9d97-6f9a8d775d32 req-6c9f5e97-3410-441a-beaf-567ee296ffe6 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:00.544012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-9847aac6-31d7-4856-9d97-6f9a8d775d32 req-6c9f5e97-3410-441a-beaf-567ee296ffe6 service nova] Creating event network-changed:593793dd-f837-4e80-96d0-022a3a027797 for instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f on hv-cinder-84684 Jul 07 04:00:00.549460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-9847aac6-31d7-4856-9d97-6f9a8d775d32 req-6c9f5e97-3410-441a-beaf-567ee296ffe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029187 Jul 07 04:00:00.550053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 158/292] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:00:00.784530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:00.785230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:00.791532 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:00.791977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:00.792780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:00.793215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:00.922289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:00.930810 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:00.932347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:00.933471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-77e04f59-8fdf-4cf1-b736-e503d4b8d997 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1407 microversion: 2.20 time: 0.153150 Jul 07 04:00:00.934023 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 159/293] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:00:00 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:00:00.942814 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:00.943415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:00.949968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:00.950414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:00.951172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:00.951666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:01.096529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:01.108108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e4a788b7-d346-46e4-b38b-f0c11d916804 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.168806 Jul 07 04:00:01.109052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 160/294] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:00 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:01.114331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:01.115204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:01.123082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:01.124082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:01.125146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:01.125877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:01.313733 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-41ce333b-a62e-46ac-8cd7-a47c377bfb36 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "POST /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.147129 Jul 07 04:00:01.315388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 135/295] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 03:59:54 2022] POST /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28/os-volume_attachments => generated 194 bytes in 7150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:01.379602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:01.389734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c587088c-031a-4da9-8921-7707efe92fa8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.279428 Jul 07 04:00:01.390449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 161/296] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:01 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:01.952993 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:01.953700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:01.960469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:01.960978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:01.962806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:01.963245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.099662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:02.107910 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:02.109461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:02.110591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-615ac86a-7186-44a4-9d03-7c5b1a264d96 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1599 microversion: 2.20 time: 0.162319 Jul 07 04:00:02.111147 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 136/297] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:00:01 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:00:02.125145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:02.125850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:02.129152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:02.129644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:02.131910 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.132394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.133850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.134290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.136425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.136890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.137651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.138093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.248591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0a9e82f7-b5fb-4f20-a359-b43ed6b7ef6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123187 Jul 07 04:00:02.249578 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 137/298] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Jul 7 04:00:02 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 04:00:02.293453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:02.303944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-41b19711-e1a6-40a7-92b1-f03c57f99175 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.182629 Jul 07 04:00:02.305331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 162/299] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:02 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:02.407493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:02.408177 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:02.419158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.419289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.420104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:02.436114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:02.618897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:02.628547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-405d2376-4144-47fa-bd76-a0ed3f645c5c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.224941 Jul 07 04:00:02.629579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 138/300] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:02 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:03.323799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:03.324380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:03.332721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:03.334069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:03.335595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:03.336783 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:03.619859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:03.638342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b08790e0-2727-4f43-864c-19bd7445eacb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.319415 Jul 07 04:00:03.639315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 163/301] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:03 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:03.646605 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:03.647272 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:03.654046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:03.654488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:03.655258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:03.655693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:03.950275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:03.973236 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0432ed81-9e49-4831-a16c-c21907dc16ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.330378 Jul 07 04:00:03.977757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 139/302] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:03 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:04.526430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-fe581226-2b18-4ebb-b9c3-e26f6ab2f54d req-f138a729-cd22-4c7d-85f5-60fd54359084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:04.536108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fe581226-2b18-4ebb-b9c3-e26f6ab2f54d req-f138a729-cd22-4c7d-85f5-60fd54359084 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:04.536597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fe581226-2b18-4ebb-b9c3-e26f6ab2f54d req-f138a729-cd22-4c7d-85f5-60fd54359084 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:04.555814 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-fe581226-2b18-4ebb-b9c3-e26f6ab2f54d req-f138a729-cd22-4c7d-85f5-60fd54359084 service nova] Creating event network-changed:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 04:00:04.574952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-fe581226-2b18-4ebb-b9c3-e26f6ab2f54d req-f138a729-cd22-4c7d-85f5-60fd54359084 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051890 Jul 07 04:00:04.578662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 164/303] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:04.655830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:04.657014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:04.665726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:04.668654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:04.669595 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:04.673028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:04.838967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:04.849245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f3572b6-a780-43b0-b798-b2d083ffe393 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.197390 Jul 07 04:00:04.851233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 140/304] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:04 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:04.995585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:04.996526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:05.005150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:05.006529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:05.008559 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:05.009247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:05.262325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:05.270202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-69449590-75c0-4467-8b02-3f2169e3d91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.279102 Jul 07 04:00:05.270775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 165/305] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:04 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:05.868083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:05.869457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:05.878004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:05.878731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:05.880238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:05.881116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:06.176077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:06.186615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2f42dfe9-070e-47aa-8f1b-4ec6ac7afb7f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.323162 Jul 07 04:00:06.198719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 141/306] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:05 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:06.294156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:06.294780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:06.302401 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:06.303024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:06.304020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:06.304477 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:06.492915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:06.502869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a8bbd910-be23-4a15-a1f0-5dde7124eab5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.217318 Jul 07 04:00:06.503578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 166/307] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:06 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:07.204183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:07.204876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:07.213049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:07.213786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:07.214748 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:07.215369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:07.416323 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:07.426400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c338cc62-64a0-4b45-a8d6-f9d73b389cd1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.225547 Jul 07 04:00:07.427651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 142/308] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:07 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:07.520826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:07.521523 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:07.527933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:07.528521 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:07.529376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:07.529865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:07.710522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:07.723187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-94e4c11f-ee77-47bd-a20e-4a68262272bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.206462 Jul 07 04:00:07.723763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 167/309] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:07 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:08.447446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:08.448749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:08.456511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:08.456614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:08.458518 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:08.459032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:08.672963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:08.680565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ef3bb3f8-cb16-4d69-bb1d-a551ed29f267 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.238080 Jul 07 04:00:08.681146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 143/310] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:08 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:08.741123 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:08.741727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:08.753485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:08.753943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:08.754714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:08.755155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:08.911734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:08.922734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-34d1f92c-b46c-40d4-a409-781ffd313ba5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.185414 Jul 07 04:00:08.924875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 168/311] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:08 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:09.699633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:09.700255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:09.707705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:09.708164 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:09.708980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:09.709936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:09.862852 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:09.872781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-976862fa-7f85-4fff-ad7c-e566665f07d2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.178398 Jul 07 04:00:09.873772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 144/312] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:09 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:09.943591 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:09.944242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:09.959075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:09.959423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:09.962065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:09.964619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:10.231877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:10.242119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16e3bb21-08f5-4402-b5e3-4f814f6006b9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.304506 Jul 07 04:00:10.245272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 169/313] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:09 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:10.702963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-b2cc004c-3771-44cf-9041-bbaa82aad264 req-03308ef2-ac05-4b1e-a036-28ce89ccc6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a22e0e-a068-4c2a-921d-4bf6b1821d4f", "name": "network-vif-plugged", "status": "completed", "tag": "593793dd-f837-4e80-96d0-022a3a027797"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:10.718266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-b2cc004c-3771-44cf-9041-bbaa82aad264 req-03308ef2-ac05-4b1e-a036-28ce89ccc6a7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:10.719178 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-b2cc004c-3771-44cf-9041-bbaa82aad264 req-03308ef2-ac05-4b1e-a036-28ce89ccc6a7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:10.740931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-b2cc004c-3771-44cf-9041-bbaa82aad264 req-03308ef2-ac05-4b1e-a036-28ce89ccc6a7 service nova] Creating event network-vif-plugged:593793dd-f837-4e80-96d0-022a3a027797 for instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f on hv-cinder-84684 Jul 07 04:00:10.751488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-b2cc004c-3771-44cf-9041-bbaa82aad264 req-03308ef2-ac05-4b1e-a036-28ce89ccc6a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054009 Jul 07 04:00:10.753024 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 145/314] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:10.890964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:10.891780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:10.897829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:10.898961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:10.900010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:10.900628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:11.044471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:11.052510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-60ee4350-ec79-40a0-b461-ea191578757e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.165474 Jul 07 04:00:11.053083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 170/315] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:10 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:11.261967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:11.262582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:11.268881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:11.269329 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:11.270085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:11.270521 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:11.402150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:11.410121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1bfc5a1f-890d-4ba8-bd98-2cc40de70f61 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.152533 Jul 07 04:00:11.410701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 146/316] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:11 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:12.069075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:12.069711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:12.076513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:12.076961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:12.077720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:12.078155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:12.216016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:12.223412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5814087a-84d7-4f83-92ae-c421463942df tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.158197 Jul 07 04:00:12.223971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 171/317] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:12 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:12.428004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:12.428660 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:12.436211 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:12.436689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:12.437449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:12.437882 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:12.572444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:12.580026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4246dc6d-c76a-424b-83c8-b9bce3c98a75 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.155805 Jul 07 04:00:12.580635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 147/318] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:12 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:13.239864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:13.240509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:13.247020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:13.247469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:13.248246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:13.248779 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:13.380754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:13.388576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-82d42d0c-f734-406d-8095-5463d4a3dca3 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.152455 Jul 07 04:00:13.389317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 172/319] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:13 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:13.597669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:13.598371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:13.606216 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:13.606670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:13.607943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:13.608582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:13.629486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:13.880789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:13.889704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-53493879-b2a1-4519-af40-d8824476058b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.296504 Jul 07 04:00:13.890280 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 148/320] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:13 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:14.404978 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:14.405901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:14.414188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:14.414667 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:14.415502 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:14.416059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:14.436415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:14.562741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:14.571280 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8a93c5fc-1ff2-43f8-a693-b8fda02d0684 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1318 microversion: 2.1 time: 0.170088 Jul 07 04:00:14.571841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 173/321] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:14 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:14.906658 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:14.907357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:14.914935 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:14.915487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:14.916346 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:14.916848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:15.062607 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:15.070696 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c0f874b5-cea2-475a-9b0f-8e5ee41d96c7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.167226 Jul 07 04:00:15.071265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 149/322] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:14 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:15.589462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:15.590071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:15.596079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:15.596557 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:15.597308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:15.597736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:15.738185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:15.745945 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-25f4c419-e068-47ab-95cd-f3081efea54c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1507 microversion: 2.1 time: 0.160245 Jul 07 04:00:15.746618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 174/323] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:15 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:16.092487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:16.093392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:16.096713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=55 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:16.105905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.106774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.107892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.108574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.266263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:16.275644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-21bf7c0a-329d-414a-9549-cf5749113b30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.191853 Jul 07 04:00:16.285815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 150/324] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:16 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:16.425303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:16.425826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:16.432480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.432926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.433670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.434097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.459154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:00:16.546888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ce4e0212-b031-46c1-acce-6ebaaba0f4ce tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 204 len: 0 microversion: 2.1 time: 0.124950 Jul 07 04:00:16.547527 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 175/325] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:00:16 2022] DELETE /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:00:16.556670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:16.557285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:16.563436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.563878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.564688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:16.565124 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:16.704635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:16.713031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fc8c41f5-5245-40c1-a86b-22b9f007106f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1554 microversion: 2.1 time: 0.161292 Jul 07 04:00:16.713594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 151/326] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:16 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:17.294032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:17.294747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:17.300713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:17.301169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:17.301932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:17.302408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:17.432929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:17.440196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-981161a4-4b4c-4129-a9c5-72dcae9e5984 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.150353 Jul 07 04:00:17.440788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 176/327] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:17 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:17.730123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:17.730740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:17.737983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:17.738500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:17.739333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:17.739829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:17.887069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:17.895995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5ffdf2ba-f8d6-4d70-92a3-52f1580cdc43 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1554 microversion: 2.1 time: 0.169581 Jul 07 04:00:17.897494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 152/328] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:17 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:18.457598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:18.458289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:18.468708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:18.469192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:18.470101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:18.470799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:18.610131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:18.617976 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-060739b1-62cf-47c5-868d-180976952e87 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.164159 Jul 07 04:00:18.618762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 177/329] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:18 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:18.915072 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:18.915588 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:18.922056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:18.922496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:18.923253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:18.923761 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:19.095355 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:19.106559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-431a8c1d-4739-4887-8306-5d252505a22e tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1554 microversion: 2.1 time: 0.195488 Jul 07 04:00:19.107166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 153/330] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:18 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:19.635930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:19.636848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:19.643134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:19.643582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:19.644380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:19.644818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:19.776857 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:19.789259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-98805eb5-6d86-46e2-bec7-6c61029a0a5f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.156527 Jul 07 04:00:19.790063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 178/331] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:19 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:20.123030 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:20.127122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:20.134685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:20.135138 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:20.135923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:20.136381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:20.212294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-eb3e114e-c4c3-4b69-bdfc-e2a1bdab340f req-4d261894-0be2-49ad-b290-eba6a1b410b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ab07d-63ab-4a0a-88b3-be2a32668f28", "name": "network-vif-deleted", "tag": "5ed11ff1-e721-490c-8d8c-22e5d1dc29a5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:20.217158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:20.226750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:20.227645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-eb3e114e-c4c3-4b69-bdfc-e2a1bdab340f req-4d261894-0be2-49ad-b290-eba6a1b410b4 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:20.228161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-eb3e114e-c4c3-4b69-bdfc-e2a1bdab340f req-4d261894-0be2-49ad-b290-eba6a1b410b4 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:20.236176 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-113bbef9-b665-4ba5-9c2f-9a10beefa6c9 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1512 microversion: 2.1 time: 0.117012 Jul 07 04:00:20.237026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 154/332] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:20 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:20.252846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-eb3e114e-c4c3-4b69-bdfc-e2a1bdab340f req-4d261894-0be2-49ad-b290-eba6a1b410b4 service nova] Creating event network-vif-deleted:5ed11ff1-e721-490c-8d8c-22e5d1dc29a5 for instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 on hv-cinder-84684 Jul 07 04:00:20.258959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-eb3e114e-c4c3-4b69-bdfc-e2a1bdab340f req-4d261894-0be2-49ad-b290-eba6a1b410b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051515 Jul 07 04:00:20.259566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 179/333] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:00:20.807857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:20.808603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:20.815951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:20.816799 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:20.817596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:20.818037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:20.947970 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:20.955549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f1131ba-7b00-46d1-a268-4ecf3a749bbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.152532 Jul 07 04:00:20.956128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 155/334] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:20 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:21.254446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:21.255146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:21.262521 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:21.262978 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:21.263740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:21.264179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:21.299452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:21.299897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:21.300380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lazy-loading 'fault' on Instance uuid e32ab07d-63ab-4a0a-88b3-be2a32668f28 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:00:21.346363 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402f0d0c41974f3088baf22d23dd0a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a5dce1a3c04a14884bb6c2bd94657b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:21.354934 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-58bf4c44-6f87-42ea-a0da-6b496ba18cc5 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 200 len: 1351 microversion: 2.1 time: 0.104764 Jul 07 04:00:21.355507 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 180/335] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:21 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:21.972784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:21.973495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:21.980854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:21.981310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:21.982083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:21.982528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:22.127523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:22.135783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e2e775f3-143f-4877-9824-d35897c79034 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.167203 Jul 07 04:00:22.136368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 156/336] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:21 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:22.373627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:22.374200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:22.381579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:22.382232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:22.382989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:22.383415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:22.531649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] HTTP exception thrown: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Request method failure captured: Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 HTTP/1.1 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlniSfWBZMcCMDwrHyG3-HYHmo3an2nZJizglxjsupw6zr5CzTkwZrauoNWaVdHepX7NAsCnAsDra09O7V7TJKRbDhKaswtJ8GfwTj_y_81-3SQEGcuvDTJ0cIXppn0yVy3yhT-_zX41N9ZF7rOdayVu_hxTLlszXNa1yXsye3TijF8 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:00:22.536109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 402f0d0c41974f3088baf22d23dd0a18 Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.537491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'e32ab07d-63ab-4a0a-88b3-be2a32668f28'} Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:22.538351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.539478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.542582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Returning 404 to user: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:22.542582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c5f17b11-0db0-4f77-aa60-436285637d86 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 404 len: 111 microversion: 2.1 time: 0.169166 Jul 07 04:00:22.542582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 181/337] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:22 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:22.653383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:22.654360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:22.660429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:22.660869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:22.661618 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:22.662053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:22.674976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] HTTP exception thrown: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Request method failure captured: Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28/os-volume_attachments HTTP/1.1 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlniSfWBZMcCMDwrHyG3-HYHmo3an2nZJizglxjsupw6zr5CzTkwZrauoNWaVdHepX7NAsCnAsDra09O7V7TJKRbDhKaswtJ8GfwTj_y_81-3SQEGcuvDTJ0cIXppn0yVy3yhT-_zX41N9ZF7rOdayVu_hxTLlszXNa1yXsye3TijF8 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:00:22.678899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 402f0d0c41974f3088baf22d23dd0a18 Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.680187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'server_id': 'e32ab07d-63ab-4a0a-88b3-be2a32668f28'} Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:22.681750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:22.683185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:22.684890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Returning 404 to user: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:22.684890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c99ad271-768e-40bf-bba9-f403020cb17f tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031352 Jul 07 04:00:22.684890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 157/338] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:00:22 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:23.153124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:23.153768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:23.159720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.160164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.160948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.161379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.310876 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:23.319804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-22c75dd7-78a9-4fa1-8053-70ad4226f91e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.170441 Jul 07 04:00:23.321147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 182/339] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:23 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:23.885954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:23.886453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:23.893067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.893512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.894265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.894702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.910949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] HTTP exception thrown: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Request method failure captured: Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 HTTP/1.1 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlniSfWBZMcCMDwrHyG3-HYHmo3an2nZJizglxjsupw6zr5CzTkwZrauoNWaVdHepX7NAsCnAsDra09O7V7TJKRbDhKaswtJ8GfwTj_y_81-3SQEGcuvDTJ0cIXppn0yVy3yhT-_zX41N9ZF7rOdayVu_hxTLlszXNa1yXsye3TijF8 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:00:23.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 402f0d0c41974f3088baf22d23dd0a18 Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.914647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'e32ab07d-63ab-4a0a-88b3-be2a32668f28'} Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:23.915681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.918311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.919978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Returning 404 to user: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:23.919978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-854283d9-1c04-40af-8a6a-48b9c4df415a tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 404 len: 111 microversion: 2.1 time: 0.032985 Jul 07 04:00:23.919978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 158/340] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:00:23 2022] DELETE /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:23.923062 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:23.923664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] [instance: e32ab07d-63ab-4a0a-88b3-be2a32668f28] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:23.929832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.930272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.931165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:23.931598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:23.944533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] HTTP exception thrown: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Request method failure captured: Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 HTTP/1.1 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlniSfWBZMcCMDwrHyG3-HYHmo3an2nZJizglxjsupw6zr5CzTkwZrauoNWaVdHepX7NAsCnAsDra09O7V7TJKRbDhKaswtJ8GfwTj_y_81-3SQEGcuvDTJ0cIXppn0yVy3yhT-_zX41N9ZF7rOdayVu_hxTLlszXNa1yXsye3TijF8 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:00:23.946165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07a5dce1a3c04a14884bb6c2bd94657b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 07a5dce1a3c04a14884bb6c2bd94657b Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723682858 Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 402f0d0c41974f3088baf22d23dd0a18 Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-DeleteServersTestJSON-1723682858-project Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.948683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'e32ab07d-63ab-4a0a-88b3-be2a32668f28'} Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:23.949580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. Jul 07 04:00:23.951109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:23.952263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] Returning 404 to user: Instance e32ab07d-63ab-4a0a-88b3-be2a32668f28 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:23.952263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1c4e28cc-b871-4347-a1df-3f3174d84623 tempest-DeleteServersTestJSON-1723682858 tempest-DeleteServersTestJSON-1723682858-project] 10.222.0.20 "GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28" status: 404 len: 111 microversion: 2.1 time: 0.028721 Jul 07 04:00:23.952263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 183/341] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:23 2022] GET /compute/v2.1/servers/e32ab07d-63ab-4a0a-88b3-be2a32668f28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:24.339021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:24.339634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:24.346028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:24.346486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:24.347267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:24.347707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:24.492713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:24.502426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-53da9ab6-68d2-4207-8cff-9304ba0a5856 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.167254 Jul 07 04:00:24.503125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 159/342] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:24 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:25.519806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:25.521203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:25.527801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:25.528215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:25.529220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:25.529645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:25.686710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:25.695688 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a4732e31-f263-44c1-b2d3-77482795141e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.178833 Jul 07 04:00:25.696789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 184/343] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:25 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:26.714134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:26.714646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:26.722270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:26.722875 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:26.724196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:26.724503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:27.151604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:27.166132 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-839a763f-fc37-4136-b6a6-cc9978dc7b2b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.455860 Jul 07 04:00:27.179291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 160/344] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:26 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:28.183351 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:28.184969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:28.192741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:28.193439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:28.194406 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:28.194831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:28.350376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:28.358757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a4753e3f-d056-4061-b5db-6ab882017ac5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1520 microversion: 2.1 time: 0.179580 Jul 07 04:00:28.359320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 185/345] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:28 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:29.376383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:29.377061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:29.384404 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:29.385146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:29.386182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:29.386686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:29.605702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:29.616772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-57460a53-48b5-4352-89ba-b8eceddf3757 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1500 microversion: 2.1 time: 0.244273 Jul 07 04:00:29.617628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 161/346] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:29 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:29.635954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:29.636753 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:29.644092 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:29.644939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:29.645969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:29.646630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-52651e72-0e3c-4e49-8226-a2ef32113874 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Action: 'create', calling method: .version_select at 0x7ff6557619d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-473011817"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:29.647141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:29.825423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:29.832883 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-46b87a32-3f07-4074-bca3-55f94772b6f2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1514 microversion: 2.1 time: 0.202472 Jul 07 04:00:29.844300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 162/347] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:29 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:30.186910 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-52651e72-0e3c-4e49-8226-a2ef32113874 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.786081 Jul 07 04:00:30.188606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 186/348] 10.222.0.20 () {60 vars in 1154 bytes} [Thu Jul 7 04:00:29 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 04:00:30.199790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c8f46b4a-659a-4e83-bac3-bc92fea3e4a0 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655757a60>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:30.269527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c8f46b4a-659a-4e83-bac3-bc92fea3e4a0 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 200 len: 344 microversion: 2.1 time: 0.074574 Jul 07 04:00:30.270950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 163/349] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:30 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:31.282855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ee175d21-fc70-4830-ab7e-e6076bcbbb32 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c9d0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:31.328872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ee175d21-fc70-4830-ab7e-e6076bcbbb32 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 200 len: 344 microversion: 2.1 time: 0.049758 Jul 07 04:00:31.329699 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 187/350] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:31 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.342085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a01c00a1-4c96-4160-9bb9-cb5252648be5 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655732d30>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:32.389554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a01c00a1-4c96-4160-9bb9-cb5252648be5 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 200 len: 345 microversion: 2.1 time: 0.051677 Jul 07 04:00:32.390316 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 164/351] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:32 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.402027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d7625737-7c7e-43eb-86ce-c171d67d7694 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Action: 'create', calling method: .version_select at 0x7ff655765700>, body: {"snapshot": {"volume_id": "958f5397-e525-47b0-8117-3516fa72afa1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1250513949"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:32.502885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:32.503888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:32.511676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:32.512135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:32.512950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:32.513395 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:32.537410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'flavor' on Instance uuid 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:00:32.567545 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d7625737-7c7e-43eb-86ce-c171d67d7694 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170002 Jul 07 04:00:32.573813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 188/352] 10.222.0.20 () {60 vars in 1161 bytes} [Thu Jul 7 04:00:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.578964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e683765a-a85e-482e-865f-b111f209a4d1 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c1f0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:32.617974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e683765a-a85e-482e-865f-b111f209a4d1 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.042587 Jul 07 04:00:32.619992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 189/353] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:32 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.622777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-568d0024-35f0-49a3-99b1-e9bae86aeae9 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/action" status: 200 len: 32 microversion: 2.1 time: 0.124649 Jul 07 04:00:32.623532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 165/354] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:00:32 2022] POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:00:32.636022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:32.636764 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:32.637350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ac42da19-6e3f-45b6-98ce-dcacf1c30561 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655761310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:32.643697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:32.644148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:32.645557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:32.645998 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:32.666229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:32.679364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ac42da19-6e3f-45b6-98ce-dcacf1c30561 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050630 Jul 07 04:00:32.679933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 190/355] 10.222.0.20 () {58 vars in 1139 bytes} [Thu Jul 7 04:00:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.698983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f47f8e6a-46e2-45d1-a657-1153a5233adc tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65588d4c0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:32.741590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f47f8e6a-46e2-45d1-a657-1153a5233adc tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.047890 Jul 07 04:00:32.742728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 191/356] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:32 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:32.815371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:32.824058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1fca3a20-3570-4fc0-854e-ef44b950efbf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.192559 Jul 07 04:00:32.824674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 166/357] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:32 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:33.755050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-45ba6a6f-b6ed-48fa-bcc4-950315cbd3d3 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655761af0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:33.784717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-45ba6a6f-b6ed-48fa-bcc4-950315cbd3d3 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.033603 Jul 07 04:00:33.785306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 192/358] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:33 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:33.842007 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:33.842650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:33.849064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:33.849510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:33.850266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:33.850957 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:33.986969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:33.995423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8dbf2433-fb2f-47f5-bbc0-830327b778a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.157282 Jul 07 04:00:33.995993 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 167/359] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:33 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:34.796681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b2117271-3c2c-4bed-aee8-1f8344f0a6d2 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655761820>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:34.825376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b2117271-3c2c-4bed-aee8-1f8344f0a6d2 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.032422 Jul 07 04:00:34.826008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 193/360] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:34 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:35.013583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:35.014121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:35.020579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:35.021032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:35.021793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:35.022232 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:35.149765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:35.157459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-65c066e9-cc37-4601-9dfb-59863f12f63d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.147798 Jul 07 04:00:35.158025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 168/361] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:35 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:35.838784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9cb57320-ff76-408f-9367-840030fc7cbb tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c280>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:35.868485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9cb57320-ff76-408f-9367-840030fc7cbb tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.034685 Jul 07 04:00:35.869049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 194/362] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:35 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:36.174390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:36.174997 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:36.181657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:36.182101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:36.182853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:36.183286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:36.310936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:36.318257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e41723bf-cefa-4b2b-a109-e6e638a4d2a5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.147775 Jul 07 04:00:36.318815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 169/363] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:36 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:36.879482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7ddbc51d-14f9-44b7-99cb-a697614f2f48 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff6557654c0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:36.911248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7ddbc51d-14f9-44b7-99cb-a697614f2f48 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.035432 Jul 07 04:00:36.912086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 195/364] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:36 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:37.335920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:37.337553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:37.344080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:37.344572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:37.345335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:37.345776 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:37.481741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:37.490071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-afebe934-8b96-4d74-ae98-405627d643c3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.157945 Jul 07 04:00:37.490649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 170/365] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:37 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:37.923945 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-454fdc2d-1fd3-4af1-ab4d-41347235281d tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c1f0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:37.953481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-454fdc2d-1fd3-4af1-ab4d-41347235281d tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.033616 Jul 07 04:00:37.954048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 196/366] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:37 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:38.506973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:38.507693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:38.514889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:38.515335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:38.516092 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:38.516547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:38.648141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:38.656193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c3d104bd-2eb4-4783-a231-e638a897510b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.152988 Jul 07 04:00:38.656801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 171/367] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:38 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:38.962794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=15 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:38.964253 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:38.968318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6f9f534e-aea3-4157-9f8c-68e308cb76e7 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff6559813a0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:38.998899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6f9f534e-aea3-4157-9f8c-68e308cb76e7 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.038164 Jul 07 04:00:38.999464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 197/368] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:38 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:39.673049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:39.673687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:39.680077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:39.680557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:39.681305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:39.681732 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:39.808101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:39.815730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f9614b82-a59d-4a65-b9fb-04127453d587 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.146452 Jul 07 04:00:39.816314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 172/369] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:39 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:40.011586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2884f2cc-a786-475d-92e2-c105688a2f40 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655761790>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:40.040566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2884f2cc-a786-475d-92e2-c105688a2f40 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.033388 Jul 07 04:00:40.041131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 198/370] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:40 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:40.833421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:40.834027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:40.841219 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:40.841608 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:40.842358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:40.842794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:40.976402 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:40.985654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a6ef4268-3fcb-4793-b162-1b1a0731c6b2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.155938 Jul 07 04:00:40.986242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 173/371] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:40 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:41.056717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a702a5d9-2ea7-4990-bf27-9b95b9ca7d89 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655765c10>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:41.090746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a702a5d9-2ea7-4990-bf27-9b95b9ca7d89 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.039427 Jul 07 04:00:41.091348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 199/372] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:41 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:42.003358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:42.003960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:42.010496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:42.010934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:42.011688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:42.012116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:42.103080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8870013c-efca-4b05-a538-76c33ba0bd47 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655875ee0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:42.132391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8870013c-efca-4b05-a538-76c33ba0bd47 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 288 microversion: 2.1 time: 0.033841 Jul 07 04:00:42.132959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 200/373] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:42 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:00:42.144876 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ee20be28-d5cd-49dc-a8e4-1b011495cc92 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c1f0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:42.147869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:42.156441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-347c7b2a-ef6b-48f1-a632-7f945e99089c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.156844 Jul 07 04:00:42.157015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 174/374] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:41 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:42.202371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ee20be28-d5cd-49dc-a8e4-1b011495cc92 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 202 len: 0 microversion: 2.1 time: 0.061867 Jul 07 04:00:42.202930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 201/375] 10.222.0.20 () {58 vars in 1253 bytes} [Thu Jul 7 04:00:42 2022] DELETE /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 04:00:42.211333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7e8e326d-39d1-4a98-ba79-6d5a71fc27d4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff6556e89d0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:42.241876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7e8e326d-39d1-4a98-ba79-6d5a71fc27d4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 200 len: 287 microversion: 2.1 time: 0.034560 Jul 07 04:00:42.242525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 175/376] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:42 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:00:43.174342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:43.174948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:43.181404 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:43.181855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:43.182612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:43.183050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:43.255261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1a2b4a37-344c-4649-ae41-3640c359f3a4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65572d1f0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:43.285676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-1a2b4a37-344c-4649-ae41-3640c359f3a4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] HTTP exception thrown: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1a2b4a37-344c-4649-ae41-3640c359f3a4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Request method failure captured: Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 HTTP/1.1 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlpd1o4Il5hVvHLH3rchcypBeL14KWquqyhqWlXV-ksr2zj4KVcKFbmrL2Sns2l2qChy2l-8DZRNV3VYat2JroY7SRTkjMZk4NIIRLeA80-xb04OHZETeIZariX3E6lZT-GaKzXXrV-MaNYot6tIMcewtguCho9nWnZCh6u-VAxo7bE Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:00:43.287973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: f634dfa697474fc2b400d8a55e4bcbb0 Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '80fbb805-2406-4c03-9dbb-d2239626dc95'} Jul 07 04:00:43.289290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. (HTTP 404) (Request-ID: req-935fe758-c39e-4ac6-aef8-6ae5f3e3ecd2) Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.290041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:43.291103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 07 04:00:43.292559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1a2b4a37-344c-4649-ae41-3640c359f3a4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Returning 404 to user: Snapshot 80fbb805-2406-4c03-9dbb-d2239626dc95 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:43.294548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1a2b4a37-344c-4649-ae41-3640c359f3a4 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95" status: 404 len: 111 microversion: 2.1 time: 0.038846 Jul 07 04:00:43.295437 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 176/377] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:00:43 2022] GET /compute/v2.1/os-snapshots/80fbb805-2406-4c03-9dbb-d2239626dc95 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:43.300516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-75249530-809d-4bf3-943a-aff0e7ff2212 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65583ee50>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:43.319328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:43.326732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-adf6edb7-a790-4eec-b2e2-e8a73b0e7586 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.156256 Jul 07 04:00:43.327365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 202/378] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:43 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:43.365599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-75249530-809d-4bf3-943a-aff0e7ff2212 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 202 len: 0 microversion: 2.1 time: 0.069805 Jul 07 04:00:43.366205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 177/379] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:00:43 2022] DELETE /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:00:43.374350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-482c8f82-c939-4882-9d57-4b5f03b8efbc tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff65576c310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:43.422303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-482c8f82-c939-4882-9d57-4b5f03b8efbc tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 200 len: 344 microversion: 2.1 time: 0.051626 Jul 07 04:00:43.422926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 203/380] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:43 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:44.344144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:44.344898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:44.351479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:44.351929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:44.352731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:44.353165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:44.435931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4a2a9f3d-a0bf-4edc-ab80-b0edcb1b2c88 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655761430>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:44.464474 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-4a2a9f3d-a0bf-4edc-ab80-b0edcb1b2c88 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] HTTP exception thrown: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4a2a9f3d-a0bf-4edc-ab80-b0edcb1b2c88 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Request method failure captured: Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 HTTP/1.1 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlpd1o4Il5hVvHLH3rchcypBeL14KWquqyhqWlXV-ksr2zj4KVcKFbmrL2Sns2l2qChy2l-8DZRNV3VYat2JroY7SRTkjMZk4NIIRLeA80-xb04OHZETeIZariX3E6lZT-GaKzXXrV-MaNYot6tIMcewtguCho9nWnZCh6u-VAxo7bE Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:00:44.467077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f634dfa697474fc2b400d8a55e4bcbb0 Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '958f5397-e525-47b0-8117-3516fa72afa1'} Jul 07 04:00:44.468562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. (HTTP 404) (Request-ID: req-0e1b9241-ba38-43d5-bd70-8d051a8c558a) Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.469415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:44.470542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 04:00:44.471781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4a2a9f3d-a0bf-4edc-ab80-b0edcb1b2c88 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Returning 404 to user: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4a2a9f3d-a0bf-4edc-ab80-b0edcb1b2c88 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 404 len: 109 microversion: 2.1 time: 0.037477 Jul 07 04:00:44.472915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 204/381] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:44 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:00:44.486200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5d6ea9d9-c685-46c1-ae10-01bea72ed918 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff655981310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:44.493881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:44.501540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-95b0f73a-ffc3-45e3-9c68-e347712ebd9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.162539 Jul 07 04:00:44.502114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 178/382] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:44 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:44.513303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-5d6ea9d9-c685-46c1-ae10-01bea72ed918 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] HTTP exception thrown: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5d6ea9d9-c685-46c1-ae10-01bea72ed918 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Request method failure captured: Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 HTTP/1.1 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlpd1o4Il5hVvHLH3rchcypBeL14KWquqyhqWlXV-ksr2zj4KVcKFbmrL2Sns2l2qChy2l-8DZRNV3VYat2JroY7SRTkjMZk4NIIRLeA80-xb04OHZETeIZariX3E6lZT-GaKzXXrV-MaNYot6tIMcewtguCho9nWnZCh6u-VAxo7bE Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:00:44.515216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f634dfa697474fc2b400d8a55e4bcbb0 Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '958f5397-e525-47b0-8117-3516fa72afa1'} Jul 07 04:00:44.516539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. (HTTP 404) (Request-ID: req-1f57d9f3-b699-4ae9-b3bd-497271ba6209) Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.517268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 04:00:44.518425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 04:00:44.519661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5d6ea9d9-c685-46c1-ae10-01bea72ed918 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Returning 404 to user: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5d6ea9d9-c685-46c1-ae10-01bea72ed918 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 404 len: 109 microversion: 2.1 time: 0.035810 Jul 07 04:00:44.521069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 205/383] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:00:44 2022] DELETE /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:00:44.525685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca925991-9d0a-4147-b352-7532c9270511 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Calling method '.version_select at 0x7ff6557329d0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:44.554284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-ca925991-9d0a-4147-b352-7532c9270511 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] HTTP exception thrown: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca925991-9d0a-4147-b352-7532c9270511 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Request method failure captured: Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 HTTP/1.1 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlpd1o4Il5hVvHLH3rchcypBeL14KWquqyhqWlXV-ksr2zj4KVcKFbmrL2Sns2l2qChy2l-8DZRNV3VYat2JroY7SRTkjMZk4NIIRLeA80-xb04OHZETeIZariX3E6lZT-GaKzXXrV-MaNYot6tIMcewtguCho9nWnZCh6u-VAxo7bE Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:00:44.556298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2104d06c9a0745e4833b0776b89d0e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2104d06c9a0745e4833b0776b89d0e87 Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1134204781 Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: f634dfa697474fc2b400d8a55e4bcbb0 Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1134204781-project Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '958f5397-e525-47b0-8117-3516fa72afa1'} Jul 07 04:00:44.557778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. (HTTP 404) (Request-ID: req-d00831ef-7de3-46fb-a193-75aef0264cbe) Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.558611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:00:44.560472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 04:00:44.561787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca925991-9d0a-4147-b352-7532c9270511 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] Returning 404 to user: Volume 958f5397-e525-47b0-8117-3516fa72afa1 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ca925991-9d0a-4147-b352-7532c9270511 tempest-VolumesSnapshotsTestJSON-1134204781 tempest-VolumesSnapshotsTestJSON-1134204781-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1" status: 404 len: 109 microversion: 2.1 time: 0.036251 Jul 07 04:00:44.563102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 179/384] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:00:44 2022] GET /compute/v2.1/os-volumes/958f5397-e525-47b0-8117-3516fa72afa1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:00:45.518400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:45.519013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:45.525094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:45.525476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:45.526246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:45.526686 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:45.662554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:45.676000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-81b0ce0e-961a-42b4-b57d-3b4665b9de4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.160696 Jul 07 04:00:45.676605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 206/385] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:45 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:46.695565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:46.696179 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:46.705328 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=48 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:46.710880 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:46.711433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:46.712379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:46.712909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:46.848901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:46.856685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-85c941fc-510f-4aeb-a999-b59145b0ab7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.165612 Jul 07 04:00:46.857422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 180/386] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:46 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:47.873977 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:47.874599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:47.881162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:47.881610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:47.882655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:47.883262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:48.022705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:48.031232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b6d34ecc-d532-485a-ac5f-514c69bd1663 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.162030 Jul 07 04:00:48.031789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 207/387] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:47 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:49.048707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:49.049315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:49.055682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:49.056127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:49.056912 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:49.057345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:49.188184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:49.195735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-92f1a429-8748-480a-b4a4-86a43d3c3abe tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.150914 Jul 07 04:00:49.196328 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 181/388] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:49 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:50.212888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:50.213503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:50.220183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:50.220660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:50.221412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:50.221837 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:50.357175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:50.364595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1f6aa816-7f7f-44f6-99b4-8e741b5e6708 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.155413 Jul 07 04:00:50.365148 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 208/389] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:50 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:51.383488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:51.384219 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:51.392153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:51.392749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:51.393508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:51.393941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:51.546449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:51.554188 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-904164c8-1bdd-44a4-9425-3e2986888a95 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.175533 Jul 07 04:00:51.555011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 182/390] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:51 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:52.574848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:52.575455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:52.581366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:52.581816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:52.582576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:52.583012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:52.714498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:52.721916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e7f31ed8-eba5-4b0a-820e-204ffa3bb11e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.151022 Jul 07 04:00:52.722470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 209/391] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:52 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:53.740532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:53.741150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:53.749099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:53.749620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:53.750574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:53.751153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:53.883393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:53.891600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-33a38271-ae0b-4907-b611-a4a8e05b7d1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.155154 Jul 07 04:00:53.892293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 183/392] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:53 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:54.287300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01b55e47-d537-41d1-913e-8451bc4897ff", "device": "/dev/sdb"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:54.289006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:54.295568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:54.296097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:54.296980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:54.297484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:54.910700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:54.911308 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:54.913920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4e0c58ff-d6c4-4be2-bfe7-c1fbb0cd037f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "POST /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630466 Jul 07 04:00:54.914519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 210/393] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:00:54 2022] POST /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:00:54.919820 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:54.920299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:54.921207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:54.921651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:55.052081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:55.060212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5ed201f6-2194-404d-9af7-0b8673d91aff tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.155203 Jul 07 04:00:55.060808 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 184/394] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:54 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:00:56.078316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:56.079290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:56.085932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.086487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.087326 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.087829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.245102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:56.254554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-95e5e5bc-2c32-42e9-b03e-ba39ef15863f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1500 microversion: 2.1 time: 0.181635 Jul 07 04:00:56.255400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 211/395] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:56 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1500 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:56.272071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec1c4848-8666-42cf-8f0e-cfc59e584cfe"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:56.273186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:56.279787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.280511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.281317 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.281915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.307913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] HTTP exception thrown: Cannot 'attach_volume' instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a while it is in vm_state rescued Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Request method failure captured: Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/os-volume_attachments HTTP/1.1 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 74 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnmzgznEnKqXoLQwL30BYHLzrx2cb07X8tvx1sQEaVckelNF3TnqHp9A1MyvtzCSKyMXeeKjY_4kaDIwIRoIhUzcHgb-pADoC34-MfZJW_aIRY_A-BSdHL0UPdyilawAG4LvhYKuq9mEGhdc86l8CYX3BO3kptwMnI_XZRJDNKoBb8 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:00:56.309592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: d8caa40d03dc43acb66dd7d6c128a61b Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {"volumeAttachment": {"volumeId": "ec1c4848-8666-42cf-8f0e-cfc59e584cfe"}} Jul 07 04:00:56.310984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Cannot 'attach_volume' instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a while it is in vm_state rescued Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'server_id': '99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a', 'body': {'volumeAttachment': {'volumeId': 'ec1c4848-8666-42cf-8f0e-cfc59e584cfe'}}} Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:00:56.311859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a while it is in vm_state rescued Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:00:56.313304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:00:56.314822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:00:56.314822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:00:56.314822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a while it is in vm_state rescued Jul 07 04:00:56.314822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:00:56.315794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Returning 409 to user: Cannot 'attach_volume' instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a while it is in vm_state rescued {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:00:56.316967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a202bcd5-51b8-4ade-b1f6-e0141c33691e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048765 Jul 07 04:00:56.317718 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 185/396] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:00:56 2022] POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 04:00:56.327030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:00:56.327570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:56.333540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.333986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.334746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.335176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.407205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-529e812f-9636-480f-beaa-8fd24976b1ae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.084183 Jul 07 04:00:56.408196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 212/397] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:00:56 2022] POST /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:00:56.416707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:56.417332 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:56.424306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.424772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.425560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:56.426352 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:56.561389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:56.568812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7c1a52c5-be20-4e18-b0bf-4ad8660c072e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1508 microversion: 2.1 time: 0.156187 Jul 07 04:00:56.569378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 186/398] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:56 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:57.588183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:57.589526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:57.596689 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:57.597143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:57.597913 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:57.598489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:57.793901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:57.802287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5deb8202-ef03-4326-93b3-3969cfdad4e4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1508 microversion: 2.1 time: 0.219238 Jul 07 04:00:57.803698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 213/399] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:57 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:00:58.820946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:00:58.821563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:00:58.828992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:58.829402 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:58.830167 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:00:58.830845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:00:58.852976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:58.976528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:00:58.985132 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-75418fe4-7d35-48d3-b932-2caec104ffc6 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1508 microversion: 2.1 time: 0.167897 Jul 07 04:00:58.985707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 187/400] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:58 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:00.002125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:00.002734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:00.009091 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:00.009540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:00.010306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:00.010723 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:00.146713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:00.155305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5b73127b-bd28-42d2-8849-cd652b5ecede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1508 microversion: 2.1 time: 0.156875 Jul 07 04:01:00.155993 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 214/401] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:00:59 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:01.173775 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:01.174498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:01.181271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:01.181813 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:01.182563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:01.183090 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:01.325058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:01.332800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a26b164c-2f84-449b-b90a-9d3e47ae977d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1508 microversion: 2.1 time: 0.163449 Jul 07 04:01:01.333861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 188/402] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:01 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:02.349608 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:02.351170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:02.359691 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:02.360411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:02.361218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:02.361657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:02.502352 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:02.510189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-86c0c5f3-9220-4de6-88db-bab1bd199d49 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1514 microversion: 2.1 time: 0.164720 Jul 07 04:01:02.510982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 215/403] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:02 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:04.889144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-62c72cf1-cf95-442e-8b69-14bc9e5514e7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: .version_select at 0x7ff6557f0ca0>, body: {"keypair": {"name": "tempest-keypair-106691451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA4aiJnpWRmNXI5FWSMqqaFkNGwfUo4bWWVcm8IjVXYWDf2xFzLxGSFvUK781JiJx+Vs3lDM1CeJQkhXIV3/yLSGT1QZhjDSFjgy3AipfLc1kLWPqADgXizpvLCU3HYXw=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:04.904899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-62c72cf1-cf95-442e-8b69-14bc9e5514e7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:01:04.908981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-62c72cf1-cf95-442e-8b69-14bc9e5514e7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for user d8caa40d03dc43acb66dd7d6c128a61b and project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:01:04.932106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-62c72cf1-cf95-442e-8b69-14bc9e5514e7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047753 Jul 07 04:01:04.932726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 189/404] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:01:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:06.305257 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1805719028", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c0310b2-bd36-4c15-b0a3-531585c03410"}], "security_groups": [{"name": "tempest-securitygroup--1850413323"}], "key_name": "tempest-keypair-106691451", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:06.406139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] validate_networks() for [('0c0310b2-bd36-4c15-b0a3-531585c03410', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:01:06.786158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:01:06.786614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:01:06.787083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:01:06.787484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:01:06.787896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:01:06.797533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:06.797982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:06.798802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:06.799241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:06.815969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:01:06.819886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Getting quotas for user d8caa40d03dc43acb66dd7d6c128a61b and project 2aefc719b77147d28ed1830d755d4d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:01:06.831878 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:01:06.834185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:01:06.881116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c0caae6a-5a63-409a-bec8-1691f17805e8 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.580102 Jul 07 04:01:06.881752 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 216/405] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:01:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:01:06.892350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-96745f93-f3fd-4c68-933e-dcce88d1e280 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:06.893054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-96745f93-f3fd-4c68-933e-dcce88d1e280 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:06.950983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-96745f93-f3fd-4c68-933e-dcce88d1e280 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:06.958425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-96745f93-f3fd-4c68-933e-dcce88d1e280 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1245 microversion: 2.1 time: 0.069912 Jul 07 04:01:06.959075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 190/406] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:06 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:01:07.975904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:07.976538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:07.985498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:07.985941 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:07.986695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:07.987150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:08.047245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:08.054930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5da76a00-de7e-4446-8d79-9c3318e7ef9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1249 microversion: 2.1 time: 0.083551 Jul 07 04:01:08.055574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 217/407] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:07 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:09.072600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:09.073223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:09.079688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:09.080144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:09.080954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:09.081396 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:09.141633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:09.148902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f5ad368e-5e01-440f-9b3f-4aef7bac391a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1241 microversion: 2.1 time: 0.080136 Jul 07 04:01:09.149477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 191/408] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:09 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:10.165250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:10.165940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:10.169733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:10.173902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:10.174354 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:10.175113 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:10.175541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:10.180616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:10.261207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:10.269702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4221d091-18df-440d-9a73-8c350eaec739 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1303 microversion: 2.1 time: 0.108301 Jul 07 04:01:10.270283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 218/409] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:10 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:11.286812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:11.287441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:11.294047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:11.294573 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:11.295337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:11.295762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:11.437500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:11.446093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c145b17e-c198-48fc-84cf-f203376a3f8d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.162887 Jul 07 04:01:11.446544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 192/410] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:11 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:01:12.463208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:12.463900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:12.483393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:12.483853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:12.484855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:12.485462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:12.775444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:12.784445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7dbd4920-6cf3-44c8-ac4b-73ffd82c5d7d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.325240 Jul 07 04:01:12.785291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 219/411] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:12 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:13.801495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:13.802075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:13.815482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:13.816314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:13.817314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:13.817977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:14.114719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:14.131191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-58c20934-e92b-4ff6-9377-3293d80f1faf tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.333544 Jul 07 04:01:14.134413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 193/412] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:13 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:01:14.259597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-71f6286d-73a7-4074-9641-6481fb6874c1 req-044c0570-e7c1-4e51-a5cd-619174d68b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:14.270665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-71f6286d-73a7-4074-9641-6481fb6874c1 req-044c0570-e7c1-4e51-a5cd-619174d68b75 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:14.271288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-71f6286d-73a7-4074-9641-6481fb6874c1 req-044c0570-e7c1-4e51-a5cd-619174d68b75 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:14.285153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-71f6286d-73a7-4074-9641-6481fb6874c1 req-044c0570-e7c1-4e51-a5cd-619174d68b75 service nova] Creating event network-changed:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:01:14.291523 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-71f6286d-73a7-4074-9641-6481fb6874c1 req-044c0570-e7c1-4e51-a5cd-619174d68b75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Jul 07 04:01:14.295397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 220/413] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:15.154907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:15.155896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:15.163034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:15.163488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:15.164484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:15.165091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:15.324201 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:15.333624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d3fa070f-a126-4908-86c9-1119cd947589 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.184922 Jul 07 04:01:15.335168 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 194/414] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:15 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:16.354356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:16.357118 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:16.368203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:16.369019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:16.371428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:16.373938 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:16.603424 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:16.614423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-45997b53-7412-4f8e-9c05-c6b58c0243f5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.267147 Jul 07 04:01:16.616496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 221/415] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:16 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:17.633923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:17.634538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:17.637048 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:17.638434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:17.644403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:17.644857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:17.645631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:17.646067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:17.813055 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:17.821974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-49eeec85-53f8-4116-bad7-3f418ff18bb7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.191907 Jul 07 04:01:17.823162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 195/416] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:17 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:18.839880 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:18.841378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:18.858021 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:18.859011 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:18.867314 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:18.867985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:18.868928 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:18.870970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:19.077036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:19.086218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-06c3d3ae-2388-47e6-86e4-7a324ff74d27 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.250018 Jul 07 04:01:19.086797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 222/417] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:18 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:20.103663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:20.104336 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:20.111582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:20.112385 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:20.113539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:20.114338 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:20.403887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:20.413543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-879f6306-4284-4a96-a908-b90cd2e6227f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.314191 Jul 07 04:01:20.414454 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 196/418] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:20 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:21.430526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:21.431722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:21.438909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:21.439602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:21.440566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:21.441006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:21.874565 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:21.888017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4c7a6fa7-987b-4b64-945b-e56c05179534 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.460459 Jul 07 04:01:21.890829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 223/419] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:21 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:22.553284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c3667593-c92f-47bd-9087-dd3edeef75f8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Action: 'create', calling method: .version_select at 0x7ff655757160>, body: {"keypair": {"name": "tempest-TestShelveInstance-834653791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEX7/LAh7xvyuFC5RyBGMqTOSb4VuHR+S27pS76W/lc1tdP+HeBPzrmO6heAq3aDpbS3EElwH0v+kDXVFWg538dMZkMzr5b7s5zjO8uvRJmTXuMmaovR05cOiHYZZOYEeg=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:22.568593 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c3667593-c92f-47bd-9087-dd3edeef75f8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Getting quotas for project d3b8ba212b774067992a28085296c091. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:01:22.572378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c3667593-c92f-47bd-9087-dd3edeef75f8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Getting quotas for user 34fe999226aa4ebaacc541e0854825bf and project d3b8ba212b774067992a28085296c091. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:01:22.597966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c3667593-c92f-47bd-9087-dd3edeef75f8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.269626 Jul 07 04:01:22.598597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 197/420] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:01:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:22.905520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:22.906141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:22.913199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:22.913656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:22.914432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:22.914864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:23.116156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:23.127295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aecf896c-4fbd-43cf-b04e-e3203517ed30 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.226216 Jul 07 04:01:23.127875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 224/421] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:22 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:24.145520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:24.146133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:24.154872 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:24.156290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:24.157197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:24.157562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:24.314659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:24.322717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-eea63642-b07e-49bf-b0ef-9d05e883652c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.181282 Jul 07 04:01:24.323508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 198/422] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:24 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:25.340844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:25.342021 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:25.348194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:25.348688 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:25.349475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:25.350159 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:25.492992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:25.503424 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-01a79a20-6442-499f-af36-f8eaa2e98f38 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.166813 Jul 07 04:01:25.514243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 225/423] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:25 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:26.521006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:26.521546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:26.528567 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:26.529009 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:26.529762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:26.530190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:26.661646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:26.669058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a79eb619-a669-4c9c-b52e-9b1d902c6ba1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.151960 Jul 07 04:01:26.669628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 199/424] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:26 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:27.686208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:27.686742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:27.693717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:27.694170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:27.694931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:27.695394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:27.826365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:27.833683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c245ea4-ac38-4a11-9527-0510078c43d4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.151522 Jul 07 04:01:27.834242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 226/425] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:27 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:28.851364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:28.851965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:28.860025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:28.860650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:28.861449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:28.861886 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:28.864650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=57 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:28.999363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:29.006794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9b0aff0e-5374-4b41-b705-c9d9075fed4c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.159519 Jul 07 04:01:29.007359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 200/426] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:28 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:30.023869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:30.024481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:30.032118 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:30.032613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:30.033394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:30.033835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:30.169203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:30.177291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8a154ae7-df4f-4d5b-a1f7-90a4f32472ee tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.157363 Jul 07 04:01:30.177870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 227/427] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:30 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:31.193946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:31.194549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:31.201025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:31.201470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:31.202274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:31.202836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:31.338585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:31.346544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-09b2ba9f-6263-4c04-a941-8ab314490ba7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.156487 Jul 07 04:01:31.347110 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 201/428] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:31 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:32.364172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:32.364772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:32.371178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:32.371631 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:32.372421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:32.372868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:32.504261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:32.511616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-22efbecf-5f5d-433d-806c-58e0caef6c83 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.151365 Jul 07 04:01:32.512184 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 228/429] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:32 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:33.529013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:33.529631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:33.532693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=4 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:33.538288 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:33.538737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:33.539500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:33.540190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:33.678771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:33.686195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-63c38939-f0bc-4bbf-b71e-8a8a277f290b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.161008 Jul 07 04:01:33.687294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 202/430] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:33 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:34.703500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:34.703980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:34.713915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:34.714361 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:34.715428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:34.715703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:34.857190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:34.865334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d0f1070c-8df4-4c35-9cfe-cb5804a6e75a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.166308 Jul 07 04:01:34.865910 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 229/431] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:34 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:35.883394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:35.884051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:35.895021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:35.895885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:35.896847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:35.897291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:36.029632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:36.037328 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e4cac00d-dfce-4bf6-9939-7088d4eaa8ca tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.158153 Jul 07 04:01:36.037888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 203/432] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:35 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:37.054264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:37.054875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:37.061787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:37.062231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:37.063206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:37.063643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:37.300400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:37.308761 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b4b5a02d-2fd5-4d70-867f-8908674fdf56 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.258140 Jul 07 04:01:37.309744 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 230/433] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:37 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:37.408150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:37.409829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:37.416601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:37.417052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:37.417854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:37.418301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:37.558307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lazy-loading 'services' on Instance uuid 20a22e0e-a068-4c2a-921d-4bf6b1821d4f {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:01:37.675103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2e605870-6f32-4b9c-a84a-03c0bdd9a3b9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f/os-volume_attachments/01b55e47-d537-41d1-913e-8451bc4897ff" status: 202 len: 0 microversion: 2.1 time: 0.270524 Jul 07 04:01:37.675700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 204/434] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:01:37 2022] DELETE /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f/os-volume_attachments/01b55e47-d537-41d1-913e-8451bc4897ff => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:01:38.326832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:38.327476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:38.334907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:38.335361 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:38.336138 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:38.336625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:38.469195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:38.478856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-50d878a4-f7d0-4571-94bd-9e6a8344f5ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.155708 Jul 07 04:01:38.479421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 231/435] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:38 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:38.858328 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-c0ea666e-d5b5-4d53-bd70-d127f4ee5441 req-ed92cdf8-e215-4c43-94c3-9997790c8d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "name": "network-vif-plugged", "status": "completed", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:38.868146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-c0ea666e-d5b5-4d53-bd70-d127f4ee5441 req-ed92cdf8-e215-4c43-94c3-9997790c8d14 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:38.868627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-c0ea666e-d5b5-4d53-bd70-d127f4ee5441 req-ed92cdf8-e215-4c43-94c3-9997790c8d14 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:38.885060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-c0ea666e-d5b5-4d53-bd70-d127f4ee5441 req-ed92cdf8-e215-4c43-94c3-9997790c8d14 service nova] Creating event network-vif-plugged:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:01:38.890370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-c0ea666e-d5b5-4d53-bd70-d127f4ee5441 req-ed92cdf8-e215-4c43-94c3-9997790c8d14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Jul 07 04:01:38.891675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 205/436] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:39.498180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:39.498995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:39.506490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:39.506721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:39.507680 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:39.508134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:39.647144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:39.654588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-02287ae8-b4d6-44de-ab68-b7b6efc11930 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.160752 Jul 07 04:01:39.655144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 232/437] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:39 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:39.884121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:39.884707 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:39.890868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:39.891313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:39.892067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:39.892667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:39.920608 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:01:40.002577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f84838d0-8dee-4fb0-8b97-1b49b81da9dc tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 204 len: 0 microversion: 2.1 time: 0.122184 Jul 07 04:01:40.003151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 206/438] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:01:39 2022] DELETE /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:01:40.011059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:40.011665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:40.018332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:40.018775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:40.019520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:40.019948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:40.146282 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:40.153579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dbfce7f6-3009-4a0d-934f-80fde72138c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.146239 Jul 07 04:01:40.154143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 233/439] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:40 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:40.671495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:40.672184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:40.678433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:40.678875 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:40.679621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:40.680045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:40.815390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:40.822953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-14eccf6f-ec7d-49ac-9a28-79129ac44c22 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.155695 Jul 07 04:01:40.823521 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 207/440] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:40 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:41.170698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:41.171305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:41.173600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=32 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:41.179411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:41.180701 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:41.181940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:41.182708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:41.186008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=92 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:41.317110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:41.324831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8c33aab3-b55c-4607-9ba5-23cb3892e18a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.157994 Jul 07 04:01:41.325391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 234/441] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:41 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:41.840586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:41.841204 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:41.848360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:41.848819 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:41.849833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:41.850271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:41.978203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:41.985499 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-addcc2a4-4740-4600-bc9c-600eaafa5b9d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.148809 Jul 07 04:01:41.986196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 208/442] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:41 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:42.342586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:42.343194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:42.350196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:42.350636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:42.351384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:42.351813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:42.483571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:42.491627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1140d773-e80b-49ab-bd30-6ecb77b3d8e9 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.152990 Jul 07 04:01:42.492238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 235/443] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:42 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:43.003226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:43.003763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:43.010485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:43.010971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:43.011738 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:43.012181 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:43.139609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:43.147569 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-36576092-780e-459a-a502-97b9601571ab tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.148944 Jul 07 04:01:43.148133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 209/444] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:42 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:43.508717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:43.509332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:43.515666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:43.516108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:43.516960 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:43.517522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:43.648531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:43.656085 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-00fdb402-bcfe-42e4-9bd8-5528cbbc4275 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.151138 Jul 07 04:01:43.656681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 236/445] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:43 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:44.164468 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:44.165074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:44.171518 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:44.171960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:44.172735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:44.173165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:44.300913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:44.308109 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0e167998-deb2-47e3-ae7c-7a103bc5f1bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.147366 Jul 07 04:01:44.308699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 210/446] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:44 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:44.673169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:44.674418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:44.680933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:44.681377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:44.682141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:44.682574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:44.815211 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:44.822506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7fb5b5c2-bc8c-4757-b0c8-d28e3c57f726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.153166 Jul 07 04:01:44.823065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 237/447] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:44 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:01:45.325016 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:45.325620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:45.332734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:45.333180 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:45.333929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:45.334357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:45.463739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:45.471272 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-976d8d34-8b25-4b51-8751-26dd62255e80 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.150071 Jul 07 04:01:45.471857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 211/448] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:45 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:45.839990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:45.840624 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:45.847606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:45.848053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:45.848846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:45.849528 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:45.975275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:45.982596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9a41aad5-61cd-4987-9b03-8259ca8b441f tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.146492 Jul 07 04:01:45.983154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 238/449] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:45 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:46.488969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:46.489495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:46.495894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:46.496383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:46.497131 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:46.497560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:46.626230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:46.634334 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7d893ddc-9662-4615-b40e-fd1d735204fa tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.149853 Jul 07 04:01:46.634891 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 212/450] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:46 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:46.999488 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:47.000019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:47.007010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:47.007454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:47.008231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:47.008727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:47.148397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:47.155724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ae27b384-7894-4f4d-8b0a-b32f75e23b56 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.160665 Jul 07 04:01:47.156287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 239/451] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:46 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:47.651109 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:47.651712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:47.654197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:47.660978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:47.661429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:47.662247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:47.662685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:47.795550 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:47.803495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-43de4c36-df9e-487d-a303-6845fe1d02bb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1371 microversion: 2.1 time: 0.156186 Jul 07 04:01:47.804064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 213/452] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:47 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:48.173110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:48.174335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:48.180828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.181275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:48.182031 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.182466 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:48.313673 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:48.321266 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bc44873a-8bf1-47a1-b16f-491b1d194467 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.151952 Jul 07 04:01:48.321834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 240/453] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:48 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:48.821017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:48.821635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:48.828105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.828599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:48.829904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.830361 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:48.961539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:48.968883 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-64f49c19-d8f7-47d1-8231-a098acf836ce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1564 microversion: 2.1 time: 0.152303 Jul 07 04:01:48.969451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 214/454] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:48 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:48.985987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:48.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:48.992630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.993079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:48.993828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:48.994260 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:49.069277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-303259b0-8e01-4088-9fbd-ddd3a0028a97 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087152 Jul 07 04:01:49.069881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 241/455] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:01:48 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:49.339222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:49.339766 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:49.346752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:49.347404 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:49.348182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:49.348673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:49.352937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:49.933504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:49.941339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-601c0f20-6f7e-441e-9740-0f8029a12a9e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1513 microversion: 2.1 time: 0.606200 Jul 07 04:01:49.942156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 215/456] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:49 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1513 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:50.391226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-35c7dfbe-9d4b-4ae3-bd4f-ff821200b747 req-20e95836-1afb-4668-8a77-8d2f152a5841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a22e0e-a068-4c2a-921d-4bf6b1821d4f", "name": "network-vif-deleted", "tag": "593793dd-f837-4e80-96d0-022a3a027797"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:50.407258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-35c7dfbe-9d4b-4ae3-bd4f-ff821200b747 req-20e95836-1afb-4668-8a77-8d2f152a5841 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:50.408353 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-35c7dfbe-9d4b-4ae3-bd4f-ff821200b747 req-20e95836-1afb-4668-8a77-8d2f152a5841 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:50.421705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-35c7dfbe-9d4b-4ae3-bd4f-ff821200b747 req-20e95836-1afb-4668-8a77-8d2f152a5841 service nova] Creating event network-vif-deleted:593793dd-f837-4e80-96d0-022a3a027797 for instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f on hv-cinder-84684 Jul 07 04:01:50.432815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-35c7dfbe-9d4b-4ae3-bd4f-ff821200b747 req-20e95836-1afb-4668-8a77-8d2f152a5841 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050099 Jul 07 04:01:50.433643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 242/457] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:01:50.959193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:50.959815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:50.966492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:50.967171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:50.967936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:50.968689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:51.004183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:51.004689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:51.005213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lazy-loading 'fault' on Instance uuid 20a22e0e-a068-4c2a-921d-4bf6b1821d4f {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:01:51.053398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:01:51.060396 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-aeade1c8-f811-4ccd-910b-de7812e44726 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 200 len: 1308 microversion: 2.1 time: 0.105727 Jul 07 04:01:51.061001 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 216/458] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:50 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:01:51.076411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:01:51.076581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:01:52.080685 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:52.081387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 20a22e0e-a068-4c2a-921d-4bf6b1821d4f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:01:52.088000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:52.088480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:52.089454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:52.089889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:52.104396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] HTTP exception thrown: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Request method failure captured: Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f HTTP/1.1 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixloS0UakG2X2KOUHFjpoGsgMlawZBdi3pKaTosyipwSBAiGmo0MMIu7Cj__pF0REzFQZksFP2TsjXRbhFZqwNJU9nVLKkflM5V1JZXg0ZLIQYZPTdLSf_HYsywwcribtJoDutJpvFzECkPYtdpGHi75nvT20QZNrE9rj9Kyr6O10KPU Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: f2434039fa054907b1f24bd0914bd8a1 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:01:52.106042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: f2434039fa054907b1f24bd0914bd8a1 Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotTestJSON-100102287-project Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 5e12c4ee289445e3a970c25bdde32e66 Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotTestJSON-100102287-project Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. Jul 07 04:01:52.107629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '20a22e0e-a068-4c2a-921d-4bf6b1821d4f'} Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:01:52.108485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. Jul 07 04:01:52.109949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:01:52.111302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Returning 404 to user: Instance 20a22e0e-a068-4c2a-921d-4bf6b1821d4f could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:01:52.111302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c757bcb-9633-4e89-a79b-71cef18b938e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f" status: 404 len: 111 microversion: 2.1 time: 0.032542 Jul 07 04:01:52.111302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 243/459] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:52 2022] GET /compute/v2.1/servers/20a22e0e-a068-4c2a-921d-4bf6b1821d4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:01:52.466192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-c5195aaf-0579-4df1-a418-1f1f088678cb req-5d84980b-0952-4ab4-b3d3-7a5a95854c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:52.477734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-c5195aaf-0579-4df1-a418-1f1f088678cb req-5d84980b-0952-4ab4-b3d3-7a5a95854c82 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:52.478245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-c5195aaf-0579-4df1-a418-1f1f088678cb req-5d84980b-0952-4ab4-b3d3-7a5a95854c82 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:52.490075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-c5195aaf-0579-4df1-a418-1f1f088678cb req-5d84980b-0952-4ab4-b3d3-7a5a95854c82 service nova] Creating event network-changed:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:01:52.495358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-c5195aaf-0579-4df1-a418-1f1f088678cb req-5d84980b-0952-4ab4-b3d3-7a5a95854c82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032834 Jul 07 04:01:52.495960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 217/460] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:01:55.185669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:01:55.186268 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:01:59.463144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1799038226", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "networks": [{"uuid": "b0f17a23-72c4-489a-ab68-20cac5f7b3ba"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:01:59.521080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] validate_networks() for [('b0f17a23-72c4-489a-ab68-20cac5f7b3ba', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:01:59.880447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:01:59.880804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:01:59.881297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:01:59.881699 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:01:59.882255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:01:59.890856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:59.891324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:59.892732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:01:59.893162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:01:59.911991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Getting quotas for project ee279093911a48c294d3c690d80076cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:01:59.915951 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Getting quotas for user 7fce57f1cf2b43a7855b70fd481a4567 and project ee279093911a48c294d3c690d80076cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:01:59.926778 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:01:59.929298 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:01:59.975428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d6ca0d45-9fa1-48df-903e-d12db055c7bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516776 Jul 07 04:01:59.976096 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 244/461] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:01:59.987422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f0fef176-1ce1-436c-9f1b-8fe0dd8b1910 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:01:59.988121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f0fef176-1ce1-436c-9f1b-8fe0dd8b1910 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:00.042063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f0fef176-1ce1-436c-9f1b-8fe0dd8b1910 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:00.051768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f0fef176-1ce1-436c-9f1b-8fe0dd8b1910 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1214 microversion: 2.1 time: 0.069397 Jul 07 04:02:00.052347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 218/462] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:01:59 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:01.069599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:01.070204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:01.078472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:01.079555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:01.080389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:01.080822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:01.139565 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:01.147751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-45e3024e-6847-468f-8eb7-ef4e6acac4fa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1266 microversion: 2.1 time: 0.082526 Jul 07 04:02:01.148327 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 245/463] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:01 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:02.164809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:02.165349 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:02.171969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:02.172455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:02.173780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:02.174213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:02.237711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:02.244988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-26b98c1a-36c7-4622-acc4-b495e5d53639 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1266 microversion: 2.1 time: 0.084091 Jul 07 04:02:02.245541 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 219/464] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:02 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:03.262034 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:03.262574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:03.269573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:03.270012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:03.270754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:03.271179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:03.333266 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:03.340480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d8c16f79-4709-410b-9d45-82c8ead74c80 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1266 microversion: 2.1 time: 0.082344 Jul 07 04:02:03.341040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 246/465] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:03 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:04.357490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:04.358100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:04.364359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:04.364800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:04.365552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:04.366008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:04.426213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:04.433493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8fe48422-97b4-4f6a-98ef-72d9e60c2aff tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1266 microversion: 2.1 time: 0.079808 Jul 07 04:02:04.434058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 220/466] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:04 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:05.086232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2119119657", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "networks": [{"uuid": "695d3476-5249-449e-98fa-5dedad501f18"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:05.140322 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] validate_networks() for [('695d3476-5249-449e-98fa-5dedad501f18', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:02:05.450502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:05.450898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:05.458037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:05.458514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:05.459280 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:05.459713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:05.541183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:05.548941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7baa9a77-dafd-4958-96d8-6dbf4d7c5cf3 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1272 microversion: 2.1 time: 0.102686 Jul 07 04:02:05.558397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 221/467] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:05 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:05.975958 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:02:05.976413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:02:05.976886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:02:05.977292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:02:05.977700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:02:05.987051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:05.987488 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:05.988283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:05.988725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:06.005779 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Getting quotas for project f2434039fa054907b1f24bd0914bd8a1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:02:06.009450 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Getting quotas for user 5e12c4ee289445e3a970c25bdde32e66 and project f2434039fa054907b1f24bd0914bd8a1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:02:06.021347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:02:06.023457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:02:06.071470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b7e749ab-31e6-4e7f-91ce-815071c38f0c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988963 Jul 07 04:02:06.072315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 247/468] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:02:06.082159 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bd0fc630-797f-4cdd-8468-f87bf3920ac6 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:06.082774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bd0fc630-797f-4cdd-8468-f87bf3920ac6 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:06.169221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bd0fc630-797f-4cdd-8468-f87bf3920ac6 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:06.177899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bd0fc630-797f-4cdd-8468-f87bf3920ac6 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1219 microversion: 2.1 time: 0.099644 Jul 07 04:02:06.178552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 222/469] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:06 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:06.234975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1449302774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-834653791", "security_groups": [{"name": "tempest-secgroup-smoke-396095447"}], "networks": [{"uuid": "d166cc1f-c0d8-4b22-863e-e950b22b276b"}], "block_device_mapping_v2": [{"uuid": "a31f95b2-ecfb-4ac6-8975-51b56fccf5f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:06.405437 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] validate_networks() for [('d166cc1f-c0d8-4b22-863e-e950b22b276b', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:02:06.565997 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:06.566626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:06.573554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:06.574278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:06.575336 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:06.575933 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:06.841012 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:06.848680 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a144725a-11ae-415b-a856-1d4c54830bba tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.286391 Jul 07 04:02:06.849594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 223/470] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:06 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:07.179616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:02:07.179943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:02:07.180421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:02:07.180831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:02:07.181266 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:02:07.192243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.192970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.193908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.194501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.196059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:07.196977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:07.208969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.211465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.214649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.215394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.216881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Getting quotas for project d3b8ba212b774067992a28085296c091. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:02:07.222221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Getting quotas for user 34fe999226aa4ebaacc541e0854825bf and project d3b8ba212b774067992a28085296c091. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:02:07.308516 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:02:07.310557 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a31f95b2-ecfb-4ac6-8975-51b56fccf5f4',volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:02:07.352228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:07.362673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4eeee336-a6ba-4da4-8e11-f68d88e18c1b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1279 microversion: 2.1 time: 0.172282 Jul 07 04:02:07.363454 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 224/471] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:07 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:07.386716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-ea223fda-85af-43a1-84c8-aa92b6318f6a req-63a22d51-c6aa-4b6e-a265-9fa66b35dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560d73fc-9903-446b-9282-042200ea3fb1", "tag": "cf83c63e-1328-46b6-ab2d-dd28d60fb40c"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:07.405805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-ea223fda-85af-43a1-84c8-aa92b6318f6a req-63a22d51-c6aa-4b6e-a265-9fa66b35dc9a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.406337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-ea223fda-85af-43a1-84c8-aa92b6318f6a req-63a22d51-c6aa-4b6e-a265-9fa66b35dc9a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.419318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-ea223fda-85af-43a1-84c8-aa92b6318f6a req-63a22d51-c6aa-4b6e-a265-9fa66b35dc9a service nova] Creating event network-changed:cf83c63e-1328-46b6-ab2d-dd28d60fb40c for instance 560d73fc-9903-446b-9282-042200ea3fb1 on hv-cinder-84684 Jul 07 04:02:07.427626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-ea223fda-85af-43a1-84c8-aa92b6318f6a req-63a22d51-c6aa-4b6e-a265-9fa66b35dc9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047275 Jul 07 04:02:07.430563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 225/472] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:07.515367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-44b74619-c7d9-4d56-8075-e9f461531ccc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.284584 Jul 07 04:02:07.515901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 248/473] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:02:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:02:07.527393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9c6eaa7d-ac99-4a89-b658-f991cb33e67a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:07.528314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9c6eaa7d-ac99-4a89-b658-f991cb33e67a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:07.590227 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9c6eaa7d-ac99-4a89-b658-f991cb33e67a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:07.599310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9c6eaa7d-ac99-4a89-b658-f991cb33e67a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1088 microversion: 2.1 time: 0.076217 Jul 07 04:02:07.600010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 226/474] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:07 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:07.865578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:07.866198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:07.872525 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.873172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:07.874144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:07.874584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.095313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:08.103765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bbf8b8aa-5b77-4a92-98a2-92d47f1af4e7 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.241963 Jul 07 04:02:08.104388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 249/475] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:07 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:08.381080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:08.381691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:08.388433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:08.388879 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.389638 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:08.390070 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.526488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:08.534570 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a7b17011-0e98-4030-903f-114a924eb454 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.158041 Jul 07 04:02:08.535146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 227/476] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:08 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:08.617201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:08.617824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:08.624838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:08.625290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.626161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:08.626599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.694728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:08.702365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7e692781-c9c6-40ed-86a6-55dd6940ae2d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1186 microversion: 2.1 time: 0.089241 Jul 07 04:02:08.702929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 250/477] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:08 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:08.884587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-465855a1-6334-405e-ab03-2ac3c28ae44d req-9e8bdf8a-361d-451f-8a01-6a0a9f15afd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfdcd80-6946-4a4f-b004-0f005a24fa54", "tag": "75f05f31-f717-431b-94db-12f116f8c66a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:08.893739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-465855a1-6334-405e-ab03-2ac3c28ae44d req-9e8bdf8a-361d-451f-8a01-6a0a9f15afd3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:08.894185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-465855a1-6334-405e-ab03-2ac3c28ae44d req-9e8bdf8a-361d-451f-8a01-6a0a9f15afd3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:08.905103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-465855a1-6334-405e-ab03-2ac3c28ae44d req-9e8bdf8a-361d-451f-8a01-6a0a9f15afd3 service nova] Creating event network-changed:75f05f31-f717-431b-94db-12f116f8c66a for instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 on hv-cinder-84684 Jul 07 04:02:08.910557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-465855a1-6334-405e-ab03-2ac3c28ae44d req-9e8bdf8a-361d-451f-8a01-6a0a9f15afd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030120 Jul 07 04:02:08.911141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 228/478] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:09.121227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:09.121768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:09.127773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.128218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.129004 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.129437 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.258960 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:09.266742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c305221c-1529-4024-854f-0b434d9bbf2a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.148825 Jul 07 04:02:09.267296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 251/479] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:09 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:09.552633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:09.553335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:09.559550 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.559988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.560758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.561186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.690871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:09.698247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-67602221-44ff-4fd8-8da2-e78ac5a4d361 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.149852 Jul 07 04:02:09.698753 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 229/480] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:09 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:09.718942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:09.719555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:09.726259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.726708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.727489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:09.727931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:09.795563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:09.803807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-57feb459-3d96-457c-8023-c47cbca9df5b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1186 microversion: 2.1 time: 0.088577 Jul 07 04:02:09.804385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 252/481] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:09 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:10.284090 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:10.284685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:10.291552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.292005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.292811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.293254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.420296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:10.427780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-add2e2d9-c11e-40bf-a6cf-e290d231313d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.148354 Jul 07 04:02:10.428366 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 230/482] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:10 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:10.715025 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:10.715566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:10.722604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.723485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.723787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.724500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.820316 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:10.821100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:10.827645 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.828289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.829186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:10.829859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:10.863664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:10.871335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-34771e13-29bf-4abe-80ec-f3203efe545b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.160094 Jul 07 04:02:10.876378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 253/483] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:10 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:10.904788 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:10.913166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c13314c7-c894-4d26-92c1-2528f2143dcb tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1186 microversion: 2.1 time: 0.096745 Jul 07 04:02:10.913736 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 231/484] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:10 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:11.444621 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:11.445345 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:11.447283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:11.452493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.452941 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:11.454347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.454791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:11.459382 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:11.583953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:11.591346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3bf14186-e18f-400a-a54d-d0e6274ee94a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.150723 Jul 07 04:02:11.591914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 254/485] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:11 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:11.887809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:11.888449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:11.895108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.895555 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:11.896338 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.896773 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:11.930310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:11.930924 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:11.937797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.938872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:11.939858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:11.940315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:12.040858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:12.049076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-faaae3c3-4cd6-493c-8797-c4f0dd15330c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1186 microversion: 2.1 time: 0.122470 Jul 07 04:02:12.049643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 255/486] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:11 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1186 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:12.085056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:12.092326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1b23a710-9dec-4f4b-a078-e15276d93873 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.208404 Jul 07 04:02:12.092889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 232/487] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:11 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:12.608724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:12.609348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:12.615692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:12.616144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:12.616931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:12.617359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:12.856496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:12.867296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39ced81a-3a2e-42c9-8255-cb950b5cd833 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.262847 Jul 07 04:02:12.868134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 256/488] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:12 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:13.068013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:13.069319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:13.077187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.078170 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:13.080505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.081665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:13.111795 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:13.113068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:13.122247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.122939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:13.123973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.124643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:13.256781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:13.267285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6adcf2a9-ed5a-4511-99a0-cb913d9c04da tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1204 microversion: 2.1 time: 0.204912 Jul 07 04:02:13.268668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 233/489] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:13 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1204 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:13.408509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:13.421806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-68420bc3-c377-4bd8-9a9f-5aff9296548d tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.315135 Jul 07 04:02:13.432834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 257/490] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:13 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:13.884384 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:13.885083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:13.891829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.892295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:13.893052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:13.893492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.031274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:14.039097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bbb0342f-acea-4b0f-b83f-18616c03c7cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.158580 Jul 07 04:02:14.039863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 234/491] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:13 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:14.279942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-3daf5a64-efdf-4af8-89d6-e89ca781bc77 req-5fe1f097-344f-499d-b9ff-bc977fbf4771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:14.285108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:14.285722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:14.292131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3daf5a64-efdf-4af8-89d6-e89ca781bc77 req-5fe1f097-344f-499d-b9ff-bc977fbf4771 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:14.292598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3daf5a64-efdf-4af8-89d6-e89ca781bc77 req-5fe1f097-344f-499d-b9ff-bc977fbf4771 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.293354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:14.293873 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.294716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:14.295244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.306231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-3daf5a64-efdf-4af8-89d6-e89ca781bc77 req-5fe1f097-344f-499d-b9ff-bc977fbf4771 service nova] Creating event network-changed:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:02:14.311081 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-3daf5a64-efdf-4af8-89d6-e89ca781bc77 req-5fe1f097-344f-499d-b9ff-bc977fbf4771 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035118 Jul 07 04:02:14.311678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 258/492] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:14.440168 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:14.440904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:14.452189 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:14.453669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:14.454271 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.455086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:14.455604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:14.460144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-91803daf-fdf6-4071-bc84-924d28477126 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.179827 Jul 07 04:02:14.460751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 235/493] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:14 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:14.589132 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:14.596501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bf92d7d9-b53d-4402-9b30-5afe387042aa tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.161303 Jul 07 04:02:14.597064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 259/494] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:14 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:15.056062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:15.056750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:15.062801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.063311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.064062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.064543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.079940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:15.193758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:15.201162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bf881be3-7a43-43ad-912e-0008a4875e02 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.148898 Jul 07 04:02:15.201731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 236/495] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:15 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:15.477794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:15.478435 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:15.485432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.485862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.486616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.487047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.613429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:15.614029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:15.619047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:15.620459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.620911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.622671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.622671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.627296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-97013994-db4e-4a11-9e0f-92d1d84a24bf tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.153518 Jul 07 04:02:15.628073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 260/496] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:15 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:15.755311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:15.762754 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-457f1ff1-c083-4786-8e0b-ccd99dd7809e tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.153269 Jul 07 04:02:15.763316 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 237/497] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:15 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:15.780552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-cfc6ed17-7ba1-40cf-9403-dc956e3e0f26 req-62aa4c48-801f-42e9-83a0-c9130718abbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560d73fc-9903-446b-9282-042200ea3fb1", "name": "network-vif-plugged", "status": "completed", "tag": "cf83c63e-1328-46b6-ab2d-dd28d60fb40c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:15.788827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-cfc6ed17-7ba1-40cf-9403-dc956e3e0f26 req-62aa4c48-801f-42e9-83a0-c9130718abbb service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:15.789290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-cfc6ed17-7ba1-40cf-9403-dc956e3e0f26 req-62aa4c48-801f-42e9-83a0-c9130718abbb service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:15.800982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-cfc6ed17-7ba1-40cf-9403-dc956e3e0f26 req-62aa4c48-801f-42e9-83a0-c9130718abbb service nova] Creating event network-vif-plugged:cf83c63e-1328-46b6-ab2d-dd28d60fb40c for instance 560d73fc-9903-446b-9282-042200ea3fb1 on hv-cinder-84684 Jul 07 04:02:15.805668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-cfc6ed17-7ba1-40cf-9403-dc956e3e0f26 req-62aa4c48-801f-42e9-83a0-c9130718abbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028682 Jul 07 04:02:15.806250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 261/498] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:16.218542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:16.221043 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:16.227450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.227889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.228667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.229095 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.358643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:16.366223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f7298e1b-4ce7-4fa7-8e2a-4bef5d4a1f84 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.152192 Jul 07 04:02:16.366787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 238/499] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:16 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:16.645177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:16.645903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:16.652108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.652594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.653342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.653776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.779582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:16.780200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:16.786632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.787081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.787846 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:16.788300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:16.790087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:16.797618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0cfe09ad-ba78-432f-bb7d-4f6238888948 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.157813 Jul 07 04:02:16.798179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 262/500] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:16 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:16.919684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:16.927722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-742256a2-6783-4de9-98a0-03e12400ca1a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.152016 Jul 07 04:02:16.928312 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 239/501] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:16 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:17.382196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:17.382801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:17.384746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:17.385395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=18 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:17.392166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.392631 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.393383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.393810 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.525263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:17.532638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e6fddb2-9cdf-4bfb-9e52-c2f750a5d528 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.154263 Jul 07 04:02:17.533197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 263/502] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:17 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:17.815026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:17.815640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:17.817547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:17.818653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=62 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:17.824460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.824913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.825677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.826119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.944812 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:17.945413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:17.952064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.952535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.953301 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:17.953734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:17.966603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:17.974682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3d4db4da-76f2-4ca7-8918-a9ea73bf5115 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.163956 Jul 07 04:02:17.975348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 240/503] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:17 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:18.152140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:18.164226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-86a2034d-f03a-41ab-8d82-31f8076b04f5 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.223146 Jul 07 04:02:18.165497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 264/504] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:17 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:18.549354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:18.549983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:18.556121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:18.556614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:18.557372 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:18.557806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:18.690134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:18.697448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5e292cd9-8eb1-429d-8a2d-7996ce93b6a9 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.152641 Jul 07 04:02:18.698002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 241/505] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:18 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:18.991265 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:18.991771 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:18.998236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:18.998677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:18.999427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:19.000402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:19.136654 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:19.144802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-acd440bc-0888-4b2c-94c5-4cbe234046cd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.157443 Jul 07 04:02:19.145359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 265/506] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:18 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:19.181503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:19.182106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:19.189367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:19.189811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:19.190562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:19.190995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:19.317294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:19.324603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a2033e98-a9e9-452d-9141-a10e3a9e5c07 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.146864 Jul 07 04:02:19.325171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 242/507] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:19 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:19.714764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:19.715463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:19.721966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:19.722420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:19.723175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:19.723605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:19.860642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:19.868170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0127dc83-d758-4e8f-85e3-f91e1e977296 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1314 microversion: 2.1 time: 0.157272 Jul 07 04:02:19.868782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 266/508] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:19 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:20.162378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:20.162986 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:20.168911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.169350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:20.170099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.170528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:20.341883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:20.343120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:20.354940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.355515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:20.356327 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.356781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:20.392130 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:20.399694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-239937ac-c979-4a87-89c6-b508b39fcbb6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.241287 Jul 07 04:02:20.400295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 243/509] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:20 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:20.504649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:20.512093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a56742fc-c918-4532-a25b-be3ab0472cfb tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.173990 Jul 07 04:02:20.512690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 267/510] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:20 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:20.884913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:20.885525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:20.891851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.892475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:20.893238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:20.893671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.022768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:21.030173 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f9beedae-5793-41e5-9b96-6577b18f6222 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1498 microversion: 2.1 time: 0.149135 Jul 07 04:02:21.030734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 244/511] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:20 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:21.415955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:21.416644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:21.425953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.426397 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.427174 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.427602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.529781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:21.530394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:21.537831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.538278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.539348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.539791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.575379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:21.583781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e9ab8837-4126-4db7-9907-95c440f67c36 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.171583 Jul 07 04:02:21.584365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 268/512] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:21 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:21.588780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:21.589277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:21.595922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.596470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.597236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.597669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.622170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:02:21.674029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:21.681841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-05974387-cb60-417a-b9ac-0f26d4a5fec4 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.155977 Jul 07 04:02:21.682427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 245/513] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:21 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:21.699169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-065a667a-c957-4157-94ec-5520f28a66a6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "DELETE /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 204 len: 0 microversion: 2.1 time: 0.113563 Jul 07 04:02:21.699748 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 269/514] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:02:21 2022] DELETE /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:02:21.708300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:21.708949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:21.715191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.715627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.716435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:21.716870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:21.848246 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:21.856096 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b2625039-4334-47ba-82c0-dfe63c4c0935 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.151548 Jul 07 04:02:21.856692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 246/515] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:21 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:22.601216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:22.601922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:22.608371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.608825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.610133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.610566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.625957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:22.699153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:22.699760 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:22.707139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.707687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.708660 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.709065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.762838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:22.771756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-145b138d-1144-4174-b6dd-5aedea9ffe1f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.174936 Jul 07 04:02:22.781651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 270/516] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:22 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:22.838368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-2f2431eb-0a90-4279-9e7f-3706f07287bb req-e7ca2277-1894-4fe2-bd0d-2a373e74bb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfdcd80-6946-4a4f-b004-0f005a24fa54", "name": "network-vif-plugged", "status": "completed", "tag": "75f05f31-f717-431b-94db-12f116f8c66a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:22.849579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2f2431eb-0a90-4279-9e7f-3706f07287bb req-e7ca2277-1894-4fe2-bd0d-2a373e74bb31 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.850179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2f2431eb-0a90-4279-9e7f-3706f07287bb req-e7ca2277-1894-4fe2-bd0d-2a373e74bb31 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.858395 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:22.868245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c044f668-d3dd-458f-a51f-49aead05de48 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.171594 Jul 07 04:02:22.869085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 247/517] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:22 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:22.873521 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:22.874123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:22.879296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-2f2431eb-0a90-4279-9e7f-3706f07287bb req-e7ca2277-1894-4fe2-bd0d-2a373e74bb31 service nova] Creating event network-vif-plugged:75f05f31-f717-431b-94db-12f116f8c66a for instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 on hv-cinder-84684 Jul 07 04:02:22.881074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.881528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.882336 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:22.882762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:22.884506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-2f2431eb-0a90-4279-9e7f-3706f07287bb req-e7ca2277-1894-4fe2-bd0d-2a373e74bb31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049925 Jul 07 04:02:22.885257 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 271/518] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:23.015886 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:23.023419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-283856da-13f4-481a-bbc1-57c9e66506cf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.153506 Jul 07 04:02:23.024000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 248/519] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:22 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:23.789362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:23.790098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:23.798158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:23.798605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:23.799370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:23.799804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:23.886653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:23.887272 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:23.893909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:23.894359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:23.895127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:23.895584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:23.952863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:23.961417 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e47b89cd-86ce-488b-ae7f-cc451974b99b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.176186 Jul 07 04:02:23.962189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 272/520] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:23 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:24.041068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:24.041446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:24.041739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:24.048818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:24.049254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:24.049656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3f67412c-2d45-42de-8998-11284f538072 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.166961 Jul 07 04:02:24.050025 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:24.050254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 249/521] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:23 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:24.050475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:24.184264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:24.192200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2c417654-6628-4b20-ad9f-76ca4e876982 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.155185 Jul 07 04:02:24.192782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 273/522] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:24 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:24.979668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:24.980291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:24.986772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:24.987213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:24.987974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:24.988429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:25.067058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:25.067715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:25.073636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:25.074080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:25.074828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:25.075257 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:25.161022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:25.168556 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8783c1aa-49b0-4276-964e-5e52f933b4ee tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.193036 Jul 07 04:02:25.169342 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 250/523] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:24 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:25.209071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:25.209684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:25.215527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:25.215966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:25.216829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:25.217323 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:25.226141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:25.233674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-51b1ac60-dd0b-44cd-98b6-bb297b7122b2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.170527 Jul 07 04:02:25.234483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 274/524] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:25 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:25.348443 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:25.356069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-59eb0372-02d8-47a1-b1a4-93f208009716 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.150791 Jul 07 04:02:25.356669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 251/525] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:25 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:26.185316 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:26.185883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:26.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.193347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.194101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.194530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.250238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:26.250844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:26.257187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.257626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.258381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.258809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.368431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:26.376861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-add449b0-b096-4395-b155-b5db107d1746 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.195328 Jul 07 04:02:26.377787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 275/526] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:26 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:26.386104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:26.386407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:26.392651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.393101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.393865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:26.394298 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:26.419204 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:26.427363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ac5d9a18-a398-4019-8afc-a9fd041d15d1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.180949 Jul 07 04:02:26.427943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 252/527] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:26 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:26.522214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:26.529547 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a5ee6599-a8f8-4a85-849a-e96f2c6095bb tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.150390 Jul 07 04:02:26.530102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 276/528] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:26 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:27.395137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:27.395749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:27.402299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.402747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.403500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.403932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.407006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:27.445465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:27.446085 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:27.452790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.453841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.454621 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.455065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.582598 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:27.590044 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b5e8396f-b3f4-4891-bf49-623203fb6127 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.198756 Jul 07 04:02:27.590620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 253/529] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:27 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:27.595811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:27.596454 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:27.602381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.602832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.603588 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:27.604023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:27.626353 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:27.633635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b1043266-416b-42e0-a594-d139c0468056 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.191965 Jul 07 04:02:27.634192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 277/530] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:27 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:27.733225 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:27.740791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b543ef62-5701-4779-b8ca-69a0a55d440b tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1504 microversion: 2.1 time: 0.149237 Jul 07 04:02:27.741349 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 254/531] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:27 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:28.578194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-47bdf79f-f6b4-4337-a11f-9821fb912ca1 req-d4459113-5979-4287-8aff-d12c16b3083e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560d73fc-9903-446b-9282-042200ea3fb1", "name": "network-vif-deleted", "tag": "cf83c63e-1328-46b6-ab2d-dd28d60fb40c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:28.586639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-47bdf79f-f6b4-4337-a11f-9821fb912ca1 req-d4459113-5979-4287-8aff-d12c16b3083e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.587079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-47bdf79f-f6b4-4337-a11f-9821fb912ca1 req-d4459113-5979-4287-8aff-d12c16b3083e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.598093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-47bdf79f-f6b4-4337-a11f-9821fb912ca1 req-d4459113-5979-4287-8aff-d12c16b3083e service nova] Creating event network-vif-deleted:cf83c63e-1328-46b6-ab2d-dd28d60fb40c for instance 560d73fc-9903-446b-9282-042200ea3fb1 on hv-cinder-84684 Jul 07 04:02:28.603288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-47bdf79f-f6b4-4337-a11f-9821fb912ca1 req-d4459113-5979-4287-8aff-d12c16b3083e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029239 Jul 07 04:02:28.603863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 278/532] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:28.607335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:28.607950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:28.614747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.615191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.615948 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.616411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.652007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:28.652827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:28.660531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.660985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.661753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.662465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.808920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:28.817631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d7fc45ba-ba73-4ecb-b04d-65d418c01ff6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.214055 Jul 07 04:02:28.818512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 255/533] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:28 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:28.823180 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:28.823907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:28.830907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.831451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.832333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:28.832840 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:28.857654 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:28.865472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-81f93fe5-dbcf-4677-aa29-811d7fd91dfd tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1319 microversion: 2.1 time: 0.218240 Jul 07 04:02:28.866700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 279/534] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:28 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:28.908611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:28.916112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-833e8223-d887-4796-856e-477d6d36fd63 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1462 microversion: 2.1 time: 0.096400 Jul 07 04:02:28.916723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 256/535] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:28 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:29.834615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:29.835233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:29.841918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:29.842362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:29.843211 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:29.844226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:29.882656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:29.883261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:29.890687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:29.891256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:29.892032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:29.892503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.024295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:30.032408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0c280141-93cf-4228-8324-a316d32f5de1 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.201587 Jul 07 04:02:30.033013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 280/536] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:29 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:30.037535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:30.038137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:30.044584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.045028 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.045787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.046218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.053672 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:30.060901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-73125b1f-a90e-46b1-a76f-3d4b7a1bb917 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1509 microversion: 2.1 time: 0.181994 Jul 07 04:02:30.061699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 257/537] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:29 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:30.079200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5654d23f-215b-4ead-a745-a5c4d3ddb604", "device": "/dev/sdb"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:30.079423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.079862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.080331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lazy-loading 'fault' on Instance uuid 560d73fc-9903-446b-9282-042200ea3fb1 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:02:30.080909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:30.086881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.087270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.088028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.088491 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.123782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:30.131486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ba81ed78-1346-4285-99d3-cc5fe9e85360 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 200 len: 1304 microversion: 2.1 time: 0.097444 Jul 07 04:02:30.132017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 281/538] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:30 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:30.360117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-02b2793b-17a1-4345-9b3c-8d44b29eb4da tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "POST /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285093 Jul 07 04:02:30.360687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 258/539] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:02:30 2022] POST /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:02:30.949054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-59364977-7ec8-4b47-9521-1005a742ecdf req-851a0095-8fb3-4ad2-84ab-5cce75e4beb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "name": "network-vif-plugged", "status": "completed", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:30.958074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-59364977-7ec8-4b47-9521-1005a742ecdf req-851a0095-8fb3-4ad2-84ab-5cce75e4beb9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:30.958578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-59364977-7ec8-4b47-9521-1005a742ecdf req-851a0095-8fb3-4ad2-84ab-5cce75e4beb9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:30.970697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-59364977-7ec8-4b47-9521-1005a742ecdf req-851a0095-8fb3-4ad2-84ab-5cce75e4beb9 service nova] Creating event network-vif-plugged:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:02:30.975633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-59364977-7ec8-4b47-9521-1005a742ecdf req-851a0095-8fb3-4ad2-84ab-5cce75e4beb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030466 Jul 07 04:02:30.976407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 282/540] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:31.051451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:31.052082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:31.058583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.059036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.059835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.060298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.148874 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:31.149773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 560d73fc-9903-446b-9282-042200ea3fb1] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:31.158095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.158558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.159320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.159754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.174459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] HTTP exception thrown: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Request method failure captured: Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 HTTP/1.1 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlqyo-SIf-VaOSLqtqgd_JMQUsuG68bNtDhNrPvyslSq8PihjGnr3Qq90QI5IKZjIDiQ_EsWAQwS7pnHYWhoBvRwnjmhbD89gFp76ZmnP3tKwz7esNgdo7Wvxltk_5XYayWdHVKMiG0jKTOo8GhOjVoTzlWO5E65RA5Lb-yf-0XLV74 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: ee279093911a48c294d3c690d80076cf Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesActionsTest-720862799 Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:02:31.176108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee279093911a48c294d3c690d80076cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee279093911a48c294d3c690d80076cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee279093911a48c294d3c690d80076cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee279093911a48c294d3c690d80076cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesActionsTest-720862799 Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: ee279093911a48c294d3c690d80076cf Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesActionsTest-720862799 Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesActionsTest-720862799-project Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 7fce57f1cf2b43a7855b70fd481a4567 Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesActionsTest-720862799-project Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. Jul 07 04:02:31.177781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '560d73fc-9903-446b-9282-042200ea3fb1'} Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:02:31.178722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. Jul 07 04:02:31.180195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:02:31.181515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Returning 404 to user: Instance 560d73fc-9903-446b-9282-042200ea3fb1 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:02:31.181515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c875a794-217c-42b6-86a6-acf21520144c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1" status: 404 len: 111 microversion: 2.1 time: 0.032794 Jul 07 04:02:31.192375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 283/541] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:31 2022] GET /compute/v2.1/servers/560d73fc-9903-446b-9282-042200ea3fb1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:02:31.220951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:31.230556 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1d2bb3b5-6e1b-4b92-abfc-de0f3ea864e0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.185069 Jul 07 04:02:31.231207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 259/542] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:31 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:31.233401 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104248873", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "networks": [{"uuid": "b0f17a23-72c4-489a-ab68-20cac5f7b3ba"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:31.285987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] validate_networks() for [('b0f17a23-72c4-489a-ab68-20cac5f7b3ba', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:02:31.631593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:02:31.632012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:02:31.632511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:02:31.632914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:02:31.633350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:02:31.642648 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.643089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.644190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:31.644654 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:31.661287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Getting quotas for project ee279093911a48c294d3c690d80076cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:02:31.665423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Getting quotas for user 7fce57f1cf2b43a7855b70fd481a4567 and project ee279093911a48c294d3c690d80076cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:02:31.675786 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:02:31.678082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:02:31.722705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8c3dcbfb-4a47-4de9-9e6f-ffaa446c15fc tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493351 Jul 07 04:02:31.723801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 284/543] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:02:31.733695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d027a018-56e2-4f70-b9ce-a6b48601c4f6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:31.734309 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d027a018-56e2-4f70-b9ce-a6b48601c4f6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:31.787232 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d027a018-56e2-4f70-b9ce-a6b48601c4f6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:31.794017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d027a018-56e2-4f70-b9ce-a6b48601c4f6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1214 microversion: 2.1 time: 0.064267 Jul 07 04:02:31.794577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 260/544] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:31 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:32.248810 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:32.249386 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:32.255315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:32.255760 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:32.256541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:32.256972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:32.388127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:32.398808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f035800c-8f0f-4839-9953-8fd56daa0092 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.154387 Jul 07 04:02:32.399362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 285/545] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:32 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:32.810705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:32.811320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:32.819000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:32.819433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:32.820211 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:32.820666 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:32.881382 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:32.888865 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fdb443e4-509e-42e6-959e-8a35322a53bd tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1210 microversion: 2.1 time: 0.081915 Jul 07 04:02:32.889435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 261/546] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:32 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:33.416985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:33.417568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:33.425100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:33.425553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:33.426319 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:33.426749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:33.572132 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:33.580102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c94649f0-53c4-4318-9804-0406983e7198 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1259 microversion: 2.1 time: 0.167430 Jul 07 04:02:33.580707 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 286/547] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:33 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:33.909221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:33.910360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:33.916969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:33.917413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:33.918172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:33.918604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:33.989579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:33.999845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f9dbfeff-1196-449a-98c7-be921bbf22bf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1274 microversion: 2.1 time: 0.096570 Jul 07 04:02:34.001013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 262/548] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:33 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:34.597552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:34.597552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:34.604682 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:34.606452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:34.607239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:34.607674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:34.746262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:34.754324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-adeebfac-7715-4ad4-a5da-6b406de30014 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1443 microversion: 2.1 time: 0.161371 Jul 07 04:02:34.754926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 287/549] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:34 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:34.771132 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:34.771741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:34.777940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:34.778384 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:34.779148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:34.779579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:34.915907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:34.926421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-42bac07e-efe0-493a-b0c6-211213418b8e tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1443 microversion: 2.1 time: 0.159084 Jul 07 04:02:34.927015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 263/550] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:34 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:35.018703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:35.019312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:35.026434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:35.027130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:35.028011 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:35.028543 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:35.494784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:35.506478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-df0c4105-9456-4eb0-a077-4f6466c3bdcf tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.492788 Jul 07 04:02:35.507210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 288/551] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:35 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:35.637438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-aebd8b85-2adf-4fcf-aba8-5b87a18e6d08 req-94c3b64e-708f-4f55-a145-26229cea0eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7ea62a-ad4a-459b-8bbe-1202a0fa091f", "tag": "3fee9621-4f82-4e91-91a7-8fae93f61414"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:35.655178 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-aebd8b85-2adf-4fcf-aba8-5b87a18e6d08 req-94c3b64e-708f-4f55-a145-26229cea0eb6 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:35.655769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-aebd8b85-2adf-4fcf-aba8-5b87a18e6d08 req-94c3b64e-708f-4f55-a145-26229cea0eb6 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:35.669627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-aebd8b85-2adf-4fcf-aba8-5b87a18e6d08 req-94c3b64e-708f-4f55-a145-26229cea0eb6 service nova] Creating event network-changed:3fee9621-4f82-4e91-91a7-8fae93f61414 for instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f on hv-cinder-84684 Jul 07 04:02:35.675516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-aebd8b85-2adf-4fcf-aba8-5b87a18e6d08 req-94c3b64e-708f-4f55-a145-26229cea0eb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041683 Jul 07 04:02:35.676192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 264/552] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:36.524124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:36.524763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:36.532090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:36.532558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:36.533323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:36.533765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:36.758315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:36.766613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-77dd7107-7ade-4602-8072-c565e9fe286a tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.246175 Jul 07 04:02:36.767203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 289/553] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:36 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:37.038094 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-77502e42-4f9c-4440-a4b4-b06696420332 req-a3638f47-9c66-4455-9539-fdfbcd62f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:37.046514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-77502e42-4f9c-4440-a4b4-b06696420332 req-a3638f47-9c66-4455-9539-fdfbcd62f4d2 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:37.047065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-77502e42-4f9c-4440-a4b4-b06696420332 req-a3638f47-9c66-4455-9539-fdfbcd62f4d2 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:37.057844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-77502e42-4f9c-4440-a4b4-b06696420332 req-a3638f47-9c66-4455-9539-fdfbcd62f4d2 service nova] Creating event network-changed:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:02:37.063733 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-77502e42-4f9c-4440-a4b4-b06696420332 req-a3638f47-9c66-4455-9539-fdfbcd62f4d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031104 Jul 07 04:02:37.064383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 265/554] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:37.782893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:37.783671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:37.789939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:37.790392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:37.791151 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:37.791638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:37.795994 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:37.924184 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:37.931732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18d2d17c-5940-425e-a08f-3062a7699264 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.152689 Jul 07 04:02:37.940140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 290/555] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:37 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:38.949202 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:38.949901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:38.956562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:38.957009 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:38.957762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:38.958199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:39.089074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:39.096805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c67c24c0-520e-4da6-af6b-046cde332904 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.151618 Jul 07 04:02:39.097348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 266/556] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:38 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:40.114324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:40.114936 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:40.121558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:40.122002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:40.122768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:40.123201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:40.249297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:40.256541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0f5e5efc-dd9e-41cc-8d78-d1b8391d6f53 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.146074 Jul 07 04:02:40.257305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 291/557] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:40 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:41.273165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:41.273776 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:41.280393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:41.280842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:41.281597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:41.282034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:41.417162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:41.431336 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3bf134ec-226f-4cd5-ae9f-649620755695 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.161443 Jul 07 04:02:41.432357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 267/558] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:41 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:42.449613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:42.450222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:42.453000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:42.453657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:42.454300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:42.461585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:42.462027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:42.462787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:42.463221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:42.590652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:42.598058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2513c2a9-2bb3-4a8a-8731-945cc58b3a4e tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.152234 Jul 07 04:02:42.598882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 292/559] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:42 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:43.615095 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:43.615706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:43.617665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:43.623455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:43.624751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:43.625542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:43.625981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:43.755561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:43.764157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-79e486d4-9187-4341-b392-ba80457c2356 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.152894 Jul 07 04:02:43.765101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 268/560] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:43 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:44.780968 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:44.781574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:44.787996 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:44.788487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:44.789246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:44.789706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:44.920166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:44.928140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cb0148ab-0303-4dfe-95a3-9ef71880afd8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.151037 Jul 07 04:02:44.928728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 293/561] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:44 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:45.944912 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:45.945563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:45.952037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:45.952516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:45.953272 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:45.953708 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:46.080444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:46.088038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8ccab061-02ea-428a-9369-cb7e3697976f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.146878 Jul 07 04:02:46.088660 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 269/562] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:45 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:47.105195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:47.105803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:47.112957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:47.113425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:47.114164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:47.114600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:47.245847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:47.253762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-20d62efc-a1fe-4e9d-8491-43076c99a6f2 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.152440 Jul 07 04:02:47.254325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 294/563] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:47 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:48.270418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:48.271028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:48.273340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=62 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:48.278657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:48.279105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:48.280415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:48.280858 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:48.409194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:48.411527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:48.418668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ec1305d2-41ed-476e-9288-188cee8f810d tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.151864 Jul 07 04:02:48.428738 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 270/564] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:48 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:49.499034 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:49.499675 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:49.506074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:49.506522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:49.507284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:49.507721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:49.633322 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:49.641574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1dec4d05-89ce-4438-b1aa-a1182a6df9f8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.146363 Jul 07 04:02:49.642255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 295/565] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:49 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:50.658388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:50.658995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:50.666983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:50.667428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:50.668191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:50.668646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:50.819241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:50.827310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-da169f4a-2720-4186-9cf0-4df31980bbe5 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.172206 Jul 07 04:02:50.827883 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 271/566] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:50 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:51.845139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:51.845834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:51.852411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:51.852862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:51.853625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:51.854059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:51.981614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:51.988902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a9ecb92a-2904-4acf-b785-cf0d8c2a0c56 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.148293 Jul 07 04:02:51.989473 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 296/567] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:51 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:53.005779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:53.006339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:53.013862 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:53.014544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:53.015565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:53.016001 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:53.149029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:53.156995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2bf48118-1b02-4875-9690-bb61f5761848 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.155797 Jul 07 04:02:53.157566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 272/568] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:53 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:53.897060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-359c6629-a8a0-4441-88f2-2673bfadad12 req-8d28e6c7-c84d-4305-8697-c5744ba9bc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7ea62a-ad4a-459b-8bbe-1202a0fa091f", "name": "network-vif-plugged", "status": "completed", "tag": "3fee9621-4f82-4e91-91a7-8fae93f61414"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:53.906684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-359c6629-a8a0-4441-88f2-2673bfadad12 req-8d28e6c7-c84d-4305-8697-c5744ba9bc2e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:53.907841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-359c6629-a8a0-4441-88f2-2673bfadad12 req-8d28e6c7-c84d-4305-8697-c5744ba9bc2e service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:53.919340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-359c6629-a8a0-4441-88f2-2673bfadad12 req-8d28e6c7-c84d-4305-8697-c5744ba9bc2e service nova] Creating event network-vif-plugged:3fee9621-4f82-4e91-91a7-8fae93f61414 for instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f on hv-cinder-84684 Jul 07 04:02:53.924875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-359c6629-a8a0-4441-88f2-2673bfadad12 req-8d28e6c7-c84d-4305-8697-c5744ba9bc2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031519 Jul 07 04:02:53.925470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 297/569] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:54.174182 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:54.174798 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:54.181335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:54.181778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:54.182533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:54.182975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:54.309874 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:54.317174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6bfac4e5-3dd9-4133-be91-ce157754a90c tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.147435 Jul 07 04:02:54.317746 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 273/570] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:54 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:55.122462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:55.123703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:55.131188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:55.131638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:55.132429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:55.132861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:55.155868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f7a405a6-d76e-4283-93c0-3a12e53bb1ae tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/ips" status: 200 len: 146 microversion: 2.1 time: 0.038125 Jul 07 04:02:55.156434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 298/571] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:02:55 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:02:55.333938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:55.334573 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:55.341028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:55.341476 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:55.342296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:55.342731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:55.471811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:55.479522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-363030ce-ea7b-4a1a-b5ff-b8c10d5b9f41 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.149409 Jul 07 04:02:55.480105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 274/572] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:55 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:56.496661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:56.497278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:56.503796 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:56.504412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:56.505168 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:56.505606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:56.639454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:56.646731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a778d9ed-1f05-409f-b868-1ce16f780589 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1314 microversion: 2.1 time: 0.153891 Jul 07 04:02:56.647292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 299/573] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:56 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:57.662904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:57.663549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:57.670789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:57.670989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:57.671920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:57.672456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:57.805457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:57.813337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a8c12132-eb1b-4213-aff9-fd1146cc37e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1498 microversion: 2.1 time: 0.154289 Jul 07 04:02:57.813904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 275/574] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:57 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:02:58.105359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:58.105872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:58.112775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.113225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.113998 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.114440 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.240581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lazy-loading 'services' on Instance uuid 8dfdcd80-6946-4a4f-b004-0f005a24fa54 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:02:58.280337 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3064fca9-fc0c-46f3-b3b3-d0e871c6279c"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:02:58.281322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:58.287503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.287955 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.288759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.289258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.355255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8f879ef0-4d90-4783-9ddf-f8202ef756c2 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54/os-volume_attachments/5654d23f-215b-4ead-a745-a5c4d3ddb604" status: 202 len: 0 microversion: 2.1 time: 0.253596 Jul 07 04:02:58.355877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 300/575] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:02:58 2022] DELETE /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54/os-volume_attachments/5654d23f-215b-4ead-a745-a5c4d3ddb604 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:02:58.451781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:58.452604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:58.458765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.459403 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.460235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.460707 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.490337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:02:58.569974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f94f2cd6-98f4-44ee-afbf-6a57dd59b2a8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 204 len: 0 microversion: 2.1 time: 0.125045 Jul 07 04:02:58.570550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 301/576] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:02:58 2022] DELETE /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:02:58.579891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:58.580399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:58.586218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.586672 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.587466 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:58.587878 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:58.604300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-83369168-cd90-4b18-9585-1b9182b5bfb7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328411 Jul 07 04:02:58.605054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 276/577] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:02:58 2022] POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:02:58.720208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:58.727994 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-23869c26-7823-4b1a-baac-ca8d86f331aa tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1504 microversion: 2.1 time: 0.153190 Jul 07 04:02:58.728586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 302/578] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:58 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:02:59.746729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:02:59.747429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:02:59.753741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:59.754184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:59.754931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:02:59.755360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:02:59.885717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:02:59.893824 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5d7d6543-0b89-44e8-b4e6-3abe4cff16e6 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1504 microversion: 2.1 time: 0.152299 Jul 07 04:02:59.894388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 277/579] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:02:59 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:00.911640 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:00.912365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:00.918751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:00.919194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:00.919948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:00.920402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.048920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:01.056455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2bcf11c2-512b-41b0-9e13-69d76862b591 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1504 microversion: 2.1 time: 0.148607 Jul 07 04:03:01.057011 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 303/580] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:00 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:01.583719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:01.583719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:01.590318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:01.590772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.591591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:01.592029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.618154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:03:01.697939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8e0c0f1e-e31f-4902-a07b-617138125e3a tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 204 len: 0 microversion: 2.1 time: 0.118206 Jul 07 04:03:01.701668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 278/581] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:03:01 2022] DELETE /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:03:01.707371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:01.708132 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:01.714374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:01.714826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.715589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:01.716024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.900035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-3dcbf9ca-85dc-41d3-80fd-11d16717386a req-a43c7a24-06c5-4454-9e1f-50c0b78d3c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7ea62a-ad4a-459b-8bbe-1202a0fa091f", "name": "network-vif-deleted", "tag": "3fee9621-4f82-4e91-91a7-8fae93f61414"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:03:01.908574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-3dcbf9ca-85dc-41d3-80fd-11d16717386a req-a43c7a24-06c5-4454-9e1f-50c0b78d3c4d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:01.909024 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-3dcbf9ca-85dc-41d3-80fd-11d16717386a req-a43c7a24-06c5-4454-9e1f-50c0b78d3c4d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:01.920045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-3dcbf9ca-85dc-41d3-80fd-11d16717386a req-a43c7a24-06c5-4454-9e1f-50c0b78d3c4d service nova] Creating event network-vif-deleted:3fee9621-4f82-4e91-91a7-8fae93f61414 for instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f on hv-cinder-84684 Jul 07 04:03:01.923373 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:01.925885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-3dcbf9ca-85dc-41d3-80fd-11d16717386a req-a43c7a24-06c5-4454-9e1f-50c0b78d3c4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Jul 07 04:03:01.926482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 279/582] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:03:01.931463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-be4baf88-578a-4a23-98da-96d0ef13222c tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1515 microversion: 2.1 time: 0.227915 Jul 07 04:03:01.932019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 304/583] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:01 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:03:02.074520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:02.075213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:02.082155 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:02.082596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:02.083341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:02.083765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:02.145311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:02.152633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ca239e10-be9c-4bf0-ac91-f0afb779b6fe tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1462 microversion: 2.1 time: 0.082260 Jul 07 04:03:02.153190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 280/584] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:02 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:02.948709 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:02.949315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:02.955640 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:02.956084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:02.956867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:02.957299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:02.971585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:03.171229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:03.172058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:03.178959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:03.180116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:03.180259 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:03.180663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:03.285751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:03.293484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-169abf3e-50cb-42de-a42f-80657bb29ef8 tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1462 microversion: 2.1 time: 0.126799 Jul 07 04:03:03.294065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 281/585] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:03 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:03:03.340598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:03.348658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e7ccf92f-1b5e-4aeb-8cea-1cf087f7281b tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1515 microversion: 2.1 time: 0.403439 Jul 07 04:03:03.349218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 305/586] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:02 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:04.310942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:04.311554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:04.318384 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:04.318834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:04.319586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:04.320020 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:04.351161 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:04.351604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:04.352045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lazy-loading 'fault' on Instance uuid 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:03:04.365353 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:04.365971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:04.372927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:04.373453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:04.374234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:04.374695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:04.393955 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce57f1cf2b43a7855b70fd481a4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee279093911a48c294d3c690d80076cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:04.401379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-61e902d5-db09-43d0-8423-07b607e0922f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 200 len: 1304 microversion: 2.1 time: 0.094308 Jul 07 04:03:04.401951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 282/587] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:04 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:04.509101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:04.517180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-be138748-6b17-4b3f-8805-eaab50827ae1 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1515 microversion: 2.1 time: 0.155743 Jul 07 04:03:04.517735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 306/588] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:04 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:05.418966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:05.419535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] [instance: 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:05.426757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:05.427207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:05.427975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:05.428436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:05.444146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] HTTP exception thrown: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Request method failure captured: Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f HTTP/1.1 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlqyo-SIf-VaOSLqtqgd_JMQUsuG68bNtDhNrPvyslSq8PihjGnr3Qq90QI5IKZjIDiQ_EsWAQwS7pnHYWhoBvRwnjmhbD89gFp76ZmnP3tKwz7esNgdo7Wvxltk_5XYayWdHVKMiG0jKTOo8GhOjVoTzlWO5E65RA5Lb-yf-0XLV74 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: ee279093911a48c294d3c690d80076cf Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-VolumesActionsTest-720862799 Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:03:05.445837 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee279093911a48c294d3c690d80076cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee279093911a48c294d3c690d80076cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee279093911a48c294d3c690d80076cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee279093911a48c294d3c690d80076cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-VolumesActionsTest-720862799 Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: ee279093911a48c294d3c690d80076cf Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-VolumesActionsTest-720862799 Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-VolumesActionsTest-720862799-project Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 7fce57f1cf2b43a7855b70fd481a4567 Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-VolumesActionsTest-720862799-project Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. Jul 07 04:03:05.447172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '3a7ea62a-ad4a-459b-8bbe-1202a0fa091f'} Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:03:05.447922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. Jul 07 04:03:05.449154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:03:05.450295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] Returning 404 to user: Instance 3a7ea62a-ad4a-459b-8bbe-1202a0fa091f could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:03:05.450295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-23fcc6f1-8df8-4a1b-921c-467c93ff5b3f tempest-VolumesActionsTest-720862799 tempest-VolumesActionsTest-720862799-project] 10.222.0.20 "GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f" status: 404 len: 111 microversion: 2.1 time: 0.032233 Jul 07 04:03:05.451220 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 283/589] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:05 2022] GET /compute/v2.1/servers/3a7ea62a-ad4a-459b-8bbe-1202a0fa091f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:03:05.529750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-e5966ba1-81d8-41c6-9e3e-5e5724e3a02e req-c4b33c6a-6c1b-4e1b-bd1d-56d5a1948586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfdcd80-6946-4a4f-b004-0f005a24fa54", "name": "network-vif-deleted", "tag": "75f05f31-f717-431b-94db-12f116f8c66a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:03:05.535308 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:05.535996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:05.544850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e5966ba1-81d8-41c6-9e3e-5e5724e3a02e req-c4b33c6a-6c1b-4e1b-bd1d-56d5a1948586 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:05.545268 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:05.546198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e5966ba1-81d8-41c6-9e3e-5e5724e3a02e req-c4b33c6a-6c1b-4e1b-bd1d-56d5a1948586 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:05.556371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:05.556371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:05.556371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:05.558921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-e5966ba1-81d8-41c6-9e3e-5e5724e3a02e req-c4b33c6a-6c1b-4e1b-bd1d-56d5a1948586 service nova] Creating event network-vif-deleted:75f05f31-f717-431b-94db-12f116f8c66a for instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 on hv-cinder-84684 Jul 07 04:03:05.565360 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-e5966ba1-81d8-41c6-9e3e-5e5724e3a02e req-c4b33c6a-6c1b-4e1b-bd1d-56d5a1948586 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041426 Jul 07 04:03:05.566300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 307/590] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:03:05.634377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e12c4ee289445e3a970c25bdde32e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2434039fa054907b1f24bd0914bd8a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:05.643103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0602f74b-177a-449a-9b83-ae73ddb38c14 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 200 len: 1473 microversion: 2.1 time: 0.112832 Jul 07 04:03:05.643900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 284/591] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:05 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 1473 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:06.124821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-840cf412-c695-4433-82f9-a9799a887fc7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:03:06.133643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-840cf412-c695-4433-82f9-a9799a887fc7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:06.134297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-840cf412-c695-4433-82f9-a9799a887fc7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:06.199605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-840cf412-c695-4433-82f9-a9799a887fc7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Going to try to stop instance {{(pid=117994) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 04:03:06.246574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-840cf412-c695-4433-82f9-a9799a887fc7 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action" status: 202 len: 0 microversion: 2.1 time: 0.125740 Jul 07 04:03:06.247176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 308/592] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:03:06 2022] POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:03:06.255258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:06.256606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:06.262904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:06.263436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:06.264327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:06.265430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:06.281195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:06.395805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:06.403814 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-167a6fea-8296-4347-8fbd-d5324af73fd3 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.152405 Jul 07 04:03:06.404410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 285/593] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:06 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:06.662853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:06.663577 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] [instance: 8dfdcd80-6946-4a4f-b004-0f005a24fa54] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:06.669733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:06.670185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:06.671537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:06.672072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:06.685030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] HTTP exception thrown: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Request method failure captured: Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 HTTP/1.1 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixloS0UakG2X2KOUHFjpoGsgMlawZBdi3pKaTosyipwSBAiGmo0MMIu7Cj__pF0REzFQZksFP2TsjXRbhFZqwNJU9nVLKkflM5V1JZXg0ZLIQYZPTdLSf_HYsywwcribtJoDutJpvFzECkPYtdpGHi75nvT20QZNrE9rj9Kyr6O10KPU Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: f2434039fa054907b1f24bd0914bd8a1 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:03:06.687446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f2434039fa054907b1f24bd0914bd8a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: f2434039fa054907b1f24bd0914bd8a1 Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-100102287 Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotTestJSON-100102287-project Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 5e12c4ee289445e3a970c25bdde32e66 Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotTestJSON-100102287-project Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. Jul 07 04:03:06.688931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '8dfdcd80-6946-4a4f-b004-0f005a24fa54'} Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:03:06.689668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. Jul 07 04:03:06.691097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:03:06.692598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] Returning 404 to user: Instance 8dfdcd80-6946-4a4f-b004-0f005a24fa54 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:03:06.692598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6547852d-e515-4e3b-a13f-b69c10c34b35 tempest-VolumesSnapshotTestJSON-100102287 tempest-VolumesSnapshotTestJSON-100102287-project] 10.222.0.20 "GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54" status: 404 len: 111 microversion: 2.1 time: 0.030654 Jul 07 04:03:06.692598 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 309/594] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:06 2022] GET /compute/v2.1/servers/8dfdcd80-6946-4a4f-b004-0f005a24fa54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:03:07.421554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:07.422164 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:07.428643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:07.429099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:07.429859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:07.430292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:07.558475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:07.566864 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b6611b29-564c-4dcc-8bff-7d890761ed49 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.149279 Jul 07 04:03:07.567424 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 286/595] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:07 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:08.583607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:08.584209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:08.590700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:08.591140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:08.591887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:08.592899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:08.722484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:08.730558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-11432f79-7042-4a5c-8923-eb47e4f53af0 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.150769 Jul 07 04:03:08.731121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 310/596] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:08 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:09.748307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:09.748983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:09.755860 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:09.756324 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:09.757091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:09.757518 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:09.890215 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:09.898166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b315e2c3-a04c-4734-b7ca-da6b003efb7c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.153655 Jul 07 04:03:09.898731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 287/597] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:09 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:10.915718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:10.916355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:10.923308 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:10.923755 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:10.924537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:10.924974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:11.054844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:11.063535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a484aba6-3f42-4195-8c36-62079a89ea33 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.151600 Jul 07 04:03:11.064100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 311/598] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:10 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:12.081121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:12.081727 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:12.088168 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:12.088646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:12.089394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:12.089826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:12.219286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:12.227462 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7563e983-a00b-427c-835e-f082844e189a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.150930 Jul 07 04:03:12.228032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 288/599] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:12 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:13.245226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:13.245988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:13.249306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:13.267037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:13.267675 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:13.268502 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:13.268942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:13.458243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:13.466668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eb096e3e-7ce2-4108-9a34-35f7d7cafa12 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.225774 Jul 07 04:03:13.468337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 312/600] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:13 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:03:14.485679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:14.486327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:14.493119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:14.493572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:14.494347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:14.494783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:14.792523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:14.804576 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4ef572eb-d8ad-41fe-9903-f644520c2c9d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.323243 Jul 07 04:03:14.815863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 289/601] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:14 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:15.823060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:15.823766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:15.833420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:15.833996 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:15.835013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:15.835680 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:16.057639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:16.067414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ccb27f7c-c601-424e-8d4a-3e5b77e2004d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.248255 Jul 07 04:03:16.068105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 313/602] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:15 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:17.085758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:17.086448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:17.093971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:17.094428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:17.095335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:17.095893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:17.260155 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:17.268546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-24df90b7-cdda-4598-b472-2dfd994d7ae6 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.186821 Jul 07 04:03:17.278351 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 290/603] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:17 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:18.286365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:18.286995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:18.293918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:18.294462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:18.295448 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:18.295914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:18.444512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:18.454400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-863b9d51-cbe2-4cc3-80f2-96851a9ff59e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.171909 Jul 07 04:03:18.456309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 314/604] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:18 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:19.471546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:19.472250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:19.475111 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:19.480519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:19.481033 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:19.481935 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:19.482498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:19.642802 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:19.655328 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0cace7d2-870e-4906-a4d8-8d9c22e5981f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.187415 Jul 07 04:03:19.657663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 291/605] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:19 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:20.675150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:20.675927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:20.681948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:20.682399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:20.683280 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:20.683727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:20.863090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:20.874935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7aea287a-873f-4cd4-a1b4-cfae0a2c3b6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.204140 Jul 07 04:03:20.875602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 315/606] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:20 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:21.892771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:21.893474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:21.900566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:21.901242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:21.902324 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:21.902920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:22.048498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:22.056971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-84cfea12-bb49-42a4-94ab-3b2d63abe288 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.169247 Jul 07 04:03:22.067470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 292/607] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:21 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:23.074645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:23.075233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:23.082155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:23.082609 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:23.083387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:23.083877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:23.218930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:23.227399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4ce01b97-316d-469f-82a0-065943bb0f40 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.156589 Jul 07 04:03:23.228224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 316/608] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:23 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:24.245987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:24.246878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:24.256521 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:24.257203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:24.258168 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:24.258757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:24.456473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:24.471594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-16f43c54-aaf3-4a6b-8b2c-197efc301371 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.230734 Jul 07 04:03:24.472503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 293/609] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:24 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:25.489645 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:25.490254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:25.499608 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:25.500055 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:25.500882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:25.501306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:25.646501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:25.657800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0a2e5588-2914-4745-b52c-0420d5919d6e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.172045 Jul 07 04:03:25.658834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 317/610] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:25 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:26.675136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:26.675757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:26.683265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:26.683667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:26.684537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:26.685786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:26.825243 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:26.834169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8eba1499-4ddc-439d-b407-b2edc854fe8c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.162693 Jul 07 04:03:26.834716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 294/611] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:26 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:27.853407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:27.854747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:27.861921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:27.862371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:27.863138 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:27.863573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:28.004802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:28.014242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-28ff7301-52ab-4b43-86f4-331cc572be22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.165189 Jul 07 04:03:28.014943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 318/612] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:27 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:29.031696 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:29.032244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:29.038751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:29.039203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:29.039967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:29.040445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:29.267114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:29.274938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7e59a71f-6161-4480-b193-e68beb129ffc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1724 microversion: 2.1 time: 0.247526 Jul 07 04:03:29.275506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 295/613] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:29 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:29.760829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:03:29.761019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:03:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:03:30.291838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:30.292475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:30.299468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:30.299924 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:30.300883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:30.301312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:30.433227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:30.442015 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d6381b73-e73f-48b7-bcb9-8b5acf8659fb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1701 microversion: 2.1 time: 0.153875 Jul 07 04:03:30.442597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 319/614] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:30 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:30.458977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-39bf9b24-46fe-46c2-a340-228bc3a673ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:03:30.465670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-39bf9b24-46fe-46c2-a340-228bc3a673ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:30.466115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-39bf9b24-46fe-46c2-a340-228bc3a673ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:30.527656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-39bf9b24-46fe-46c2-a340-228bc3a673ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Going to try to start instance {{(pid=117995) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 04:03:30.569083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-39bf9b24-46fe-46c2-a340-228bc3a673ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action" status: 202 len: 0 microversion: 2.1 time: 0.113723 Jul 07 04:03:30.569747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 296/615] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:03:30 2022] POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:03:30.578969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:30.579585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:30.585724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:30.586174 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:30.586935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:30.587370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:30.731439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:30.739429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-25503570-b1b1-448e-8247-e7a305b79248 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1710 microversion: 2.1 time: 0.165484 Jul 07 04:03:30.740003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 320/616] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:30 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:31.758076 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:31.758697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:31.764840 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:31.765280 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:31.766023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:31.766453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:31.894930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:31.902937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-29780318-8e58-4451-ac22-5060657a48c4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1710 microversion: 2.1 time: 0.149567 Jul 07 04:03:31.903530 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 297/617] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:31 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:32.921194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:32.921894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:32.928290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:32.928753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:32.929508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:32.929940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:33.151764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:33.154718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:33.162434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e93f635e-cdf6-4f14-b063-d3eabf42b889 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1714 microversion: 2.1 time: 0.245555 Jul 07 04:03:33.163297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 321/618] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:03:32 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1714 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:03:36.200823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:36.201326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:36.208186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:36.208668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:36.209436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:36.209868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:36.234560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c6561714-e1b8-4c03-98e7-c0e78157a273 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.212514 Jul 07 04:03:36.235131 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 298/619] 10.222.0.20 () {60 vars in 1288 bytes} [Thu Jul 7 04:03:36 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/ips => generated 152 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 04:03:40.194846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:03:40.195413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:40.202873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:40.203311 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:40.204065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:40.204537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:40.227305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lazy-loading 'flavor' on Instance uuid 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:03:40.521060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c82e6d4d-5932-4e01-88fc-a18a30b78ffc tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/action" status: 202 len: 0 microversion: 2.20 time: 0.330183 Jul 07 04:03:40.525042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 322/620] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jul 7 04:03:40 2022] POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:03:40.533634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:40.534478 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:40.547227 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:40.547746 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:40.548547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:40.548982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:40.553729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:40.725888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:40.736585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:40.741375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:40.742944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5185dba0-cf0e-44c4-b643-ea4d730f9924 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.214690 Jul 07 04:03:40.743928 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 299/621] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:40 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:41.764023 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:41.764757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:41.771919 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:41.772489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:41.773284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:41.773718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:41.905457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:41.913348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:41.914851 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:41.915995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-67a58862-b80f-41c8-bd54-c8b4b02d01b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.156790 Jul 07 04:03:41.916580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 323/622] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:41 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:42.934671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:42.935944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:42.946028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:42.947177 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:42.948634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:42.949188 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:43.148555 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:43.157485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:43.159278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:43.160479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-577a2ca8-f708-4745-8f3f-b1a873f8656b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.230096 Jul 07 04:03:43.161175 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 300/623] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:42 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:44.178783 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:44.179931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:44.182592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=24 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:44.188639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:44.189094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:44.189856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:44.190288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:44.332580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:44.340655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:44.342147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:44.343294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8dfd4508-a3a7-4ceb-9941-cf057eb25147 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.168328 Jul 07 04:03:44.343842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 324/624] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:44 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:45.361942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:45.362483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:45.368814 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:45.369257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:45.370034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:45.370463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:45.507962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:45.516581 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:45.518059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:45.519197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-08fd33d5-09c6-4dd9-b6db-09a3e60133df tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.161348 Jul 07 04:03:45.519765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 301/625] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:45 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:46.537098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:46.537707 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:46.544191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:46.545273 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:46.546052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:46.546485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:46.674678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:46.682499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:46.684006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:46.685345 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-99ffd745-8d1f-4eb5-9c0a-e52320c48910 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.151964 Jul 07 04:03:46.686001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 325/626] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:46 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:47.704728 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:47.705254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:47.711659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:47.712099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:47.712878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:47.713306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:47.842591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:47.850737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:47.852233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:47.853412 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4aa9f7fe-155d-4b41-8496-586048aee3ec tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.153580 Jul 07 04:03:47.853994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 302/627] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:47 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:03:48.871807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:48.872436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:48.878916 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:48.879354 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:48.880099 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:48.880558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:49.010515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:49.018941 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:49.020663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:49.021898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9fe9daa6-42a0-4246-bc07-166ef4350fa7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.153903 Jul 07 04:03:49.022469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 326/628] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:48 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:50.039470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:50.040081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:50.042443 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=24 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:50.048405 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:50.048851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:50.049612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:50.050051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:50.181080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:50.189777 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:50.191277 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:50.192466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7a666d3b-96d8-47c6-98a6-4d1b5524f639 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.156867 Jul 07 04:03:50.193024 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 303/629] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:50 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:51.210743 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:51.211256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:51.217800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:51.218244 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:51.218989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:51.219415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:51.356917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:51.364727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:51.366202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:51.367332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-568a6e76-336a-4d8b-beae-75fedb10a290 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.160586 Jul 07 04:03:51.367879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 327/630] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:51 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:52.386263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:52.386871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:52.393592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:52.394031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:52.394776 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:52.395200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:52.523800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:52.531695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:52.533215 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:52.534363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d6a9e0e4-7bd7-4e9f-8984-218492b29609 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.152069 Jul 07 04:03:52.534916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 304/631] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:52 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:53.552257 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:53.552893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:53.559222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:53.559663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:53.560445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:53.560877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:53.691198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:53.698929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:53.700451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:53.701585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-929e7122-d0a2-4c1d-9d57-3b691dc2bdd6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.153173 Jul 07 04:03:53.702732 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 328/632] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:53 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:54.720388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:54.721145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:54.727679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:54.728127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:54.728933 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:54.729368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:54.865089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:54.873062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:54.875232 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:54.876401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f7367cd3-3d5d-48c7-8e5a-d6bc86effa8e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.160309 Jul 07 04:03:54.876952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 305/633] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:54 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:55.894983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:55.895589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:55.901684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:55.902127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:55.902886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:55.903407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:56.039201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:56.047909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:56.049427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:56.050554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ca6d552f-55dd-403c-bccf-6e7a3f3e833a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.159392 Jul 07 04:03:56.051106 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 329/634] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:55 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:57.069289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:57.069903 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:57.076440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:57.076892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:57.079717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:57.080163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:57.215465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:57.223852 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:57.225401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:57.226780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6adca6bc-c565-4ad2-a98d-22b8b6d038da tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.161337 Jul 07 04:03:57.227347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 306/635] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:57 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:58.245006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:58.246357 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:58.253593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:58.254104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:58.254934 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:58.255425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:58.407222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:58.416088 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:58.417643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:58.418862 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55ab287d-0131-4070-bb66-9a16e8ecf16c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.177651 Jul 07 04:03:58.425136 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 330/636] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:58 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:03:59.439184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:03:59.440520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:03:59.454668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:59.455526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:59.456555 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:03:59.457139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:03:59.681436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:59.691027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:59.692967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:03:59.694287 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-73f949bf-d3f9-4322-9f20-1490d3255926 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.260364 Jul 07 04:03:59.695233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 307/637] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:03:59 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:00.714115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:00.714635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:00.723861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:00.724467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:00.725332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:00.726064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:00.947243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:00.956678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:00.958392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:00.960049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c6dbf1d1-b51a-42d9-9192-297eb280e4a7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.249620 Jul 07 04:04:00.960166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 331/638] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:00 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:01.978511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:01.979125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:01.986699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:01.987170 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:01.987942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:01.988410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:02.525803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:02.535416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:02.537139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:02.538518 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-056e85b9-7923-4cfa-b7a3-5af3e0c19b42 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.563830 Jul 07 04:04:02.539191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 308/639] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:01 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:03.568216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:03.572720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:03.586821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:03.589082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:03.590202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:03.590649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:03.832457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:03.842480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:03.845377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:03.846684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-31596b62-df10-4ae9-a1cc-b59e3e6da251 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.292774 Jul 07 04:04:03.847983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 332/640] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:03 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:04.867319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:04.868067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:04.876114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:04.876744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:04.878416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:04.879097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:05.141565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:05.156945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:05.160025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:05.164105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0f9e4d6e-0e4d-414d-a485-bbd3f724b086 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.299428 Jul 07 04:04:05.166801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 309/641] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:04 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:05.375194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-4afb899a-7d98-474d-baa3-6e33ad540bcb req-586f0e9b-978b-440e-a930-63d20b47900a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "name": "network-vif-plugged", "status": "completed", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:05.397578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4afb899a-7d98-474d-baa3-6e33ad540bcb req-586f0e9b-978b-440e-a930-63d20b47900a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:05.398013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4afb899a-7d98-474d-baa3-6e33ad540bcb req-586f0e9b-978b-440e-a930-63d20b47900a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:05.423736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-4afb899a-7d98-474d-baa3-6e33ad540bcb req-586f0e9b-978b-440e-a930-63d20b47900a service nova] Creating event network-vif-plugged:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 04:04:05.430626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-4afb899a-7d98-474d-baa3-6e33ad540bcb req-586f0e9b-978b-440e-a930-63d20b47900a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060945 Jul 07 04:04:05.431325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 333/642] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:04:06.185044 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:06.185823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:06.208514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:06.209050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:06.217275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:06.218541 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:06.782876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:06.793367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:06.795064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:06.796894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b4b432ca-df92-4ded-a238-416c66537114 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.617854 Jul 07 04:04:06.797963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 310/643] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:06 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:07.816376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:07.816997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:07.828579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:07.829384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:07.830402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:07.831048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:08.004241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:08.019989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:08.021847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:08.023060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8af9fbe5-4781-4649-af9c-a47f625efb3a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1745 microversion: 2.20 time: 0.211729 Jul 07 04:04:08.023808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 334/644] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:07 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:09.036072 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0f5cde0f-0bfa-4c58-9dae-1fbad27aee2a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Action: 'create', calling method: .version_select at 0x7ff65557cc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1275067466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmjyxVBmo+BVAAVDCAmdoZQE4Bz5lAXejyc1CEIA2uKethvqCX49YKzYS7w3WGfh6EbURS4NAmuf4K+1w+XKrBdagK6hrYBpUqZdWBG02mJN5uUfhzAvUMFXZzmg+XK+g=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:09.047798 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:09.055388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:09.066002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:09.066757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:09.067741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:09.068594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:09.079621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-0f5cde0f-0bfa-4c58-9dae-1fbad27aee2a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for project d90ba1d25fd3421796320121b8a38fa1. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:04:09.095325 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-0f5cde0f-0bfa-4c58-9dae-1fbad27aee2a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for user f90b6a7eecf247ac9baa9351ae51096d and project d90ba1d25fd3421796320121b8a38fa1. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:04:09.130400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0f5cde0f-0bfa-4c58-9dae-1fbad27aee2a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.330576 Jul 07 04:04:09.132225 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 311/645] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:04:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:04:09.257039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:09.267499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:09.269816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:09.271297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-07a5cb97-27a2-4ff9-9071-66ab41db1acf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.232647 Jul 07 04:04:09.272513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 335/646] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:09 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:10.293537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:10.295036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:10.318983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:10.319705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:10.321869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:10.322477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:10.614940 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:10.617758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=76 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:10.635829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:10.637297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:10.638965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7c1b511e-773b-4b96-9144-b64390816f09 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.352209 Jul 07 04:04:10.640213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 312/647] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:10 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:11.663618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:11.668005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:11.688571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:11.690585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:11.691444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:11.692141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:11.703229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:11.985499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:12.009139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:12.011574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:12.013371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c5bc109-c683-41fd-a6bb-2f2d51b4f334 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.358251 Jul 07 04:04:12.014652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 336/648] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:11 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:13.034145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:13.035417 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:13.047284 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:13.047733 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:13.051301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:13.052126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:13.273761 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:13.287898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:13.290213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:13.293937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b5197234-ffdc-4588-a46f-e060eebbc0d3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.264672 Jul 07 04:04:13.310721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 313/649] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:13 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:14.319120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:14.320826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:14.323559 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=26 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:14.329509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:14.329956 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:14.330891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:14.331320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:14.489635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:14.499818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:14.501395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:14.502578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39d80b42-fb7e-4627-9f92-ad873ad28f95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.187449 Jul 07 04:04:14.503158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 337/650] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:14 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:15.521102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:15.521738 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:15.528564 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:15.529313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:15.530847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:15.531310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:15.687432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:15.695689 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:15.697470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:15.698679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2f51c434-63c8-4d02-a8ae-08004b9b3a51 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.181767 Jul 07 04:04:15.699244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 314/651] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:15 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:16.717493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:16.718361 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:16.726356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:16.726805 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:16.727587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:16.728010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:16.872894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:16.882634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:16.884366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:16.885785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-272a4c00-7db4-4048-ab1e-9f10156edd9d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.172424 Jul 07 04:04:16.886646 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 338/652] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:16 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:17.904729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:17.906202 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:17.912806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:17.913253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:17.914017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:17.914450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:18.053405 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:18.069983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:18.072760 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:18.075117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9912f8c4-2d39-44a0-9ec0-5a08e237c084 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.173819 Jul 07 04:04:18.089386 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 315/653] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:17 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:19.098837 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:19.099467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:19.106953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:19.107403 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:19.109124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:19.109587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:19.253992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:19.262386 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:19.265877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:19.266111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-68ee83cb-ab99-43c1-b940-868bb5e1bb48 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.172296 Jul 07 04:04:19.274051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 339/654] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:19 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:20.285315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:20.286123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:20.289283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=4 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:20.290114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:20.296354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:20.296800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:20.297586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:20.298056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:20.475316 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:20.486925 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:20.488804 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:20.490174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6d492d84-c8e5-45aa-8763-1e8a3c62b1a1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.209701 Jul 07 04:04:20.491031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 316/655] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:20 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:04:21.509466 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:21.510158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:21.517462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:21.517907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:21.518893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:21.519161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:21.650158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:21.659024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:21.660560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:21.661714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-378bfde1-657c-4528-8845-ec4ee374a246 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.156131 Jul 07 04:04:21.662265 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 340/656] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:21 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:22.680220 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:22.680851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:22.687991 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:22.688466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:22.689217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:22.689646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:22.845055 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:22.855308 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:22.857312 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:22.859072 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c8e6adbb-1778-45ae-ba7f-717038d93bac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1740 microversion: 2.20 time: 0.182579 Jul 07 04:04:22.859667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 317/657] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:22 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:23.877843 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:23.878473 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:23.885074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:23.885520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:23.886273 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:23.886703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:24.015806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:24.023668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:24.025204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:24.026349 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a6c7846d-61d9-42e4-bc58-9c4d98527775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1722 microversion: 2.20 time: 0.152409 Jul 07 04:04:24.026905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 341/658] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:23 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:25.046520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:25.047304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:25.055085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:25.055752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:25.056820 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:25.057412 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:25.192195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:25.200232 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:25.202482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:25.203968 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3101a83b-4555-4361-b7f7-c28ccb591679 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1722 microversion: 2.20 time: 0.162363 Jul 07 04:04:25.204647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 318/659] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:25 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:25.302994 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-99ffc8d5-7930-436f-a65d-b32e41af45f7 req-32ef8499-b9de-468c-b83e-9bd5713107d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "name": "network-vif-unplugged", "status": "completed", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:25.312490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-99ffc8d5-7930-436f-a65d-b32e41af45f7 req-32ef8499-b9de-468c-b83e-9bd5713107d9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:25.312927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-99ffc8d5-7930-436f-a65d-b32e41af45f7 req-32ef8499-b9de-468c-b83e-9bd5713107d9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:25.323545 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-99ffc8d5-7930-436f-a65d-b32e41af45f7 req-32ef8499-b9de-468c-b83e-9bd5713107d9 service nova] Creating event network-vif-unplugged:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 04:04:25.328670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-99ffc8d5-7930-436f-a65d-b32e41af45f7 req-32ef8499-b9de-468c-b83e-9bd5713107d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088802 Jul 07 04:04:25.329240 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 342/660] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:04:26.223257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:26.223821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:26.230436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.230879 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.231633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.232063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.366014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:26.374550 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:26.376050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:26.377226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b3b5382c-aa25-46d8-a474-d06aa6234326 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1725 microversion: 2.20 time: 0.158251 Jul 07 04:04:26.377796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 319/661] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:26 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:26.395893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6cb400f-b5c8-4f9f-99e6-61d751e3fe83"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:26.397058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:26.403177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.403626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.404413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.405453 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.683452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bc26aba3-5c69-4587-b1d1-b0b613f1da75 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292180 Jul 07 04:04:26.684079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 343/662] 10.222.0.20 () {62 vars in 1363 bytes} [Thu Jul 7 04:04:26 2022] POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 04:04:26.796252 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:26.796842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:26.802802 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.803257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.804012 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.804479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.940099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-95e4e854-83b7-4e70-9ba5-2b3c3d08ea6c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/action" status: 202 len: 0 microversion: 2.20 time: 0.148153 Jul 07 04:04:26.943630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 320/663] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jul 7 04:04:26 2022] POST /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 07 04:04:26.948858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:26.949541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:26.956816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.957263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:26.958197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:26.958786 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:27.096047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:27.104550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:27.106079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:27.107221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0c74561b-8e77-4a60-a5f8-079ac9962936 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1751 microversion: 2.20 time: 0.162200 Jul 07 04:04:27.107792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 344/664] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:26 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:27.567887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79f04473-6ec6-44d0-9d68-9f49fbf6213f"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:27.569172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:27.576036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:27.577277 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:27.577995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:27.578422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:27.871521 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a5754ae2-a409-4b51-b7a9-c0c17158e830 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407266 Jul 07 04:04:27.872257 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 321/665] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:04:27 2022] POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:04:28.125770 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:28.126375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:28.132869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:28.133321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:28.134082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:28.134524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:28.270474 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:28.278661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:28.280133 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:28.281973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f4d3895e-20f3-44f9-b2b4-96d77de893ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.160838 Jul 07 04:04:28.282527 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 345/666] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:28 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:29.302641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:29.303358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:29.310301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:29.310921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:29.311789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:29.312673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:29.443241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:29.451840 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:29.453673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:29.454848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-08a5159d-c6bf-493b-b98b-58362a701248 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.156924 Jul 07 04:04:29.455408 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 322/667] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:29 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:04:30.474356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:30.474964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:30.481338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:30.481784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:30.482541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:30.482975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:30.612867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:30.621548 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:30.623049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:30.624204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0e4458a9-989b-41d7-87ac-ccf98607c7dd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.153990 Jul 07 04:04:30.625146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 346/668] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:30 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:04:31.643239 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:31.643848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:31.650378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:31.650823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:31.651580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:31.652014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:31.779100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:31.787975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:31.789516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:31.790665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-95fd17c8-12c6-4d95-b8cd-17551b71ae93 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.151909 Jul 07 04:04:31.791242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 323/669] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:31 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:32.808777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:32.809389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:32.816504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:32.816959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:32.817719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:32.818157 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:32.949325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:32.958047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:32.959544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:32.960723 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-46c40494-ca22-4f6e-9e27-985fe3e9729a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.155831 Jul 07 04:04:32.961284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 347/670] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:32 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:33.979102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:33.979712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:33.987148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:33.987675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:33.988652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:33.989230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:34.117083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:34.126461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:34.127994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:34.129181 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-92f784f3-043f-440a-a9c0-d852cf5e5175 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.153939 Jul 07 04:04:34.129747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 324/671] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:33 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:35.147584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:35.148194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:35.154658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:35.155107 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:35.156518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:35.156972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:35.291095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:35.300405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:35.301844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:35.303027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-06c9f055-ac5e-4662-aef7-f77bbd1980c6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.159386 Jul 07 04:04:35.303562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 348/672] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:35 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:36.320423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:36.321036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:36.327355 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.327946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.328787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.329304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.423923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:36.424993 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:36.431643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.432420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.433198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.433865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.463414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'flavor' on Instance uuid c9e14bc5-d51a-4264-a422-1061afe5509a {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:04:36.483158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:36.493246 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:36.494691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:36.495867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ac88772e-7f7c-402b-a031-1101debd494e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1753 microversion: 2.20 time: 0.179359 Jul 07 04:04:36.496446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 325/673] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:36 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:36.548634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:36.590798 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a51d0b81-5624-4b32-8f91-3bc59516318b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/action" status: 200 len: 32 microversion: 2.1 time: 0.171152 Jul 07 04:04:36.591352 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 349/674] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:04:36 2022] POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 04:04:36.600505 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:36.601112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:36.607585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.608025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.608822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:36.609252 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:36.866957 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:36.877519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f068fb4b-74ae-4c0b-8a84-8e1272accd04 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.279975 Jul 07 04:04:36.878313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 326/675] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:36 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:37.516115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:37.518885 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:37.527323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:37.528098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:37.529126 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:37.529567 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:37.708507 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:37.719502 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:37.721180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:37.721311 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1747061834", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275067466", "security_groups": [{"name": "tempest-secgroup-smoke-152699616"}], "block_device_mapping_v2": [{"uuid": "93b37509-c0d3-4718-ba7d-a682652ed451", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e6f7a7e-402a-4bce-9487-7febb928a485"}]}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:37.722980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-df3d15cd-52a9-48ec-9545-d80f4597608e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.212190 Jul 07 04:04:37.723612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 350/676] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:37 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:37.834310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] validate_networks() for [('7e6f7a7e-402a-4bce-9487-7febb928a485', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:04:37.895770 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:37.896434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:37.902739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:37.903180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:37.903953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:37.904605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:38.089823 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:38.099462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a5de91e4-44b3-4802-9bf1-c58c770e0c15 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.207656 Jul 07 04:04:38.100046 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 351/677] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:37 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:38.278114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:04:38.278690 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:04:38.279190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:04:38.279601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:04:38.280010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:04:38.289458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:38.289894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:38.290687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:38.291123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:38.298458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:38.310755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:04:38.314885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for user f90b6a7eecf247ac9baa9351ae51096d and project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:04:38.372198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:04:38.374399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93b37509-c0d3-4718-ba7d-a682652ed451',volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:04:38.506281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c4ef6578-15a0-4d78-ac03-ffca8bdf7914 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789521 Jul 07 04:04:38.506846 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 327/678] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:04:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:04:38.517687 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dbf37ae1-6c4c-4ca5-bc08-557dc5978a56 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:38.518504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dbf37ae1-6c4c-4ca5-bc08-557dc5978a56 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:38.579142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dbf37ae1-6c4c-4ca5-bc08-557dc5978a56 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:38.585886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dbf37ae1-6c4c-4ca5-bc08-557dc5978a56 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1095 microversion: 2.1 time: 0.072853 Jul 07 04:04:38.586457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 352/679] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:38 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:38.750551 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:38.751281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:38.768976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:38.769763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:38.770794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:38.771452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:38.962221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:38.973276 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:38.975498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:38.977115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b4ad1c5a-b265-4321-8435-3eb73b7c7421 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.239106 Jul 07 04:04:38.978340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 328/680] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:38 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:39.117791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:39.118708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:39.126497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:39.127586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:39.128444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:39.129272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:39.267300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:39.282261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8c7a3591-b8b1-4dd4-9fe6-82f5c619fddc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.168356 Jul 07 04:04:39.282853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 353/681] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:39 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:39.603319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f9b5c90b-e1b0-46e1-80c0-7b4db9ba2f65 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:39.603939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f9b5c90b-e1b0-46e1-80c0-7b4db9ba2f65 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:39.675844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9b5c90b-e1b0-46e1-80c0-7b4db9ba2f65 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:39.682896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f9b5c90b-e1b0-46e1-80c0-7b4db9ba2f65 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1095 microversion: 2.1 time: 0.083381 Jul 07 04:04:39.688848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 329/682] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:39 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:39.996932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:39.997465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:40.004867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:40.005306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:40.006050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:40.006479 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:40.139409 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:40.147576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:40.149099 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:40.150234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f9e6dc02-3443-4f51-9f89-a57c16de5f14 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.157362 Jul 07 04:04:40.150781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 354/683] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:39 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:40.299660 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:40.300211 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:40.307439 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:40.307897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:40.308704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:40.309453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:40.448838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:40.457788 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0539d631-9c87-49c3-aade-77e45a3a649d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.162706 Jul 07 04:04:40.459041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 330/684] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:40 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:40.699959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9371eaa6-ba5f-4190-80dc-480f31b87af9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:40.700869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9371eaa6-ba5f-4190-80dc-480f31b87af9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:40.760572 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9371eaa6-ba5f-4190-80dc-480f31b87af9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:40.767945 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9371eaa6-ba5f-4190-80dc-480f31b87af9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1095 microversion: 2.1 time: 0.071935 Jul 07 04:04:40.768555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 355/685] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:40 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:41.167907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:41.168548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:41.175319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.175771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.176596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.177036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.333135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:41.341768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:41.343923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:41.345156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1ddf638f-dc46-4815-9cc1-40ee38882d1e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.181202 Jul 07 04:04:41.345714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 331/686] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:41 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:41.477293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:41.477948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:41.485223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.485840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.486677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.487189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.625910 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:41.634528 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e9dc5cae-ae6c-4169-a37d-5e6ee3f92d62 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.162274 Jul 07 04:04:41.640710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 356/687] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:41 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:41.785264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:41.785805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:41.793163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.793612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.794383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:41.794824 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:41.862010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:41.869808 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-14e3f99d-555c-48e4-a8f9-e3af50d74231 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.088535 Jul 07 04:04:41.870549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 332/688] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:41 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:42.370268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:42.370883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:42.377594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.378039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.378792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.379225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.551425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:42.562071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:42.563606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:42.564814 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2145f39b-9836-499d-8774-b0bb6756fd25 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.198516 Jul 07 04:04:42.565611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 357/689] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:42 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:42.652709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:42.653300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:42.660626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.661082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.661867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.662307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.797498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:42.805653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-733f8c73-7da8-4bee-b572-cfc437d0baae tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.156978 Jul 07 04:04:42.806459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 333/690] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:42 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:42.887826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:42.888487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:42.895338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.895782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.896578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:42.897003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:42.966307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:42.975216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-93f2129c-8743-4d30-8b9e-773dd51a80b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.091300 Jul 07 04:04:42.975785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 358/691] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:42 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:43.585414 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:43.586205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:43.592798 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:43.593407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:43.594189 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:43.594700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:43.727545 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:43.736196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:43.738111 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:43.739496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f9fd3d82-221d-43b0-89d6-2dcbc98f9430 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.159124 Jul 07 04:04:43.740078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 334/692] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:43 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:43.823337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:43.824189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:43.833703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:43.834429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:43.835503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:43.836004 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:43.971756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:43.980809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bdfd6f7e-222d-4c5e-b95d-8adeb63c4048 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.161511 Jul 07 04:04:43.982007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 359/693] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:43 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:43.992435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:43.993392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:44.002698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:44.003571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:44.005901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:44.006697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:44.076562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:44.085149 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6499ec65-34a6-46cf-b70d-575ecd51380f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.096430 Jul 07 04:04:44.085803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 335/694] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:43 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:44.759332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:44.759868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:44.765622 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=50 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.767111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:44.768292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:44.769160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:44.769633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:44.916512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:44.926898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:44.929258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:44.930454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-539e8d70-3ce4-408c-90b4-5dbffea17f97 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.175078 Jul 07 04:04:44.931226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 360/695] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:44 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:44.997779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:44.998383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:45.005358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.005803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:45.006615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.007102 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:45.103229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:45.103851 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:45.111858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.112339 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:45.113124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.113555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:45.146206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:45.154224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-11d08e18-331e-4b36-b0ea-2787f580022e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.160269 Jul 07 04:04:45.154806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 336/696] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:44 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:45.177933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:45.185714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-953af5f1-56cf-464a-b7d4-78c5a4c0b365 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.086237 Jul 07 04:04:45.196411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 361/697] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:45 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:45.949994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:45.950613 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:45.957047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.957510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:45.958286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:45.958729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:46.103064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:46.112901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:46.114404 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:46.115580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2ca7b843-d171-43ad-a420-558f8aabc8b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.169522 Jul 07 04:04:46.116150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 337/698] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:45 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:46.173309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:46.174049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:46.180638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:46.181091 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:46.181858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:46.182297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:46.203359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:46.204242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:46.216098 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:46.216916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:46.217897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:46.220349 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:46.320574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:46.329238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-95a9259e-148a-45e6-b1e0-c3b948809a7e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.129913 Jul 07 04:04:46.329893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 338/699] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:46 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:46.374128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:46.383382 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cee2f7f9-bee7-49fa-a698-3732c1a5fcef tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.213824 Jul 07 04:04:46.394222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 362/700] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:46 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:47.134560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:47.135192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:47.141721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.142168 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.143140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.143574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.279028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:47.288184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:47.289705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:47.290863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ee9364c5-78bf-450d-8259-7869f9c83b49 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.160253 Jul 07 04:04:47.291428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 339/701] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:47 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:47.347190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:47.347842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:47.355102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.355555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.356480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.357022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.401912 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:47.402438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:47.408822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.409301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.410061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:47.410494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:47.422233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:47.429672 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b60e3aa9-fda8-4e27-8838-12748cf6d94d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.087505 Jul 07 04:04:47.430247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 363/702] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:47 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:47.556163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:47.564470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5612cda4-7da5-4fd2-af3a-1d0a4d26399b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.166286 Jul 07 04:04:47.565074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 340/703] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:47 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:48.310224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:48.310985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:48.317731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.318292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.319141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.319638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.446302 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:48.447015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:48.450493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:48.454254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.455209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.455420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:48.455840 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.456153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.464938 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:48.466422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:48.467570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-db83f3e8-e0c4-46aa-9607-3d7ebb940bd9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.161275 Jul 07 04:04:48.468125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 364/704] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:48 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:48.530026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:48.538240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-81acc69d-09a2-4fa6-ab90-8e88c1c2f1da tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.095807 Jul 07 04:04:48.538805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 341/705] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:48 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:48.582937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:48.583623 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:48.590177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.590631 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.591419 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:48.591857 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:48.735054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:48.743774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-09da2b84-32c4-448d-8bde-f82d58a22562 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.165784 Jul 07 04:04:48.744385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 365/706] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:48 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:49.487015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:49.487620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:49.494097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.494540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.495291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.495722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.554855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:49.555469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:49.561832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.562272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.563029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.563459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.631068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:49.638404 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2f76a25c-4ebe-4aa0-94cc-eb140f5960ad tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.087217 Jul 07 04:04:49.639127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 366/707] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:49 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:49.654237 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:49.662992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:49.664530 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:49.665687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-799caf96-5022-419a-a303-c3bb3b5290e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.182864 Jul 07 04:04:49.666447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 342/708] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:49 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:49.762292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:49.762847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:49.769944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.770428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.771178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:49.771673 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:49.786346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:49.901505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:49.909600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d4e0a7c5-3d46-4bdf-9e23-b0c14a333b1d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.151154 Jul 07 04:04:49.910163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 367/709] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:49 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:50.655014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:50.655629 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:50.657507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=8 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.658708 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.664185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.664658 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:50.665418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.665851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:50.686766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:50.687377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:50.694571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.695019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:50.695774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.696203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:50.728815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:50.737120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b3666337-d3a1-4cec-a406-b64770328327 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.085948 Jul 07 04:04:50.737692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 343/710] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:50 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:50.766903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.828445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:50.837292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:50.838794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:50.839933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9d3a2061-ff3a-4a5f-b2f0-68190de2b0fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.157008 Jul 07 04:04:50.840564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 368/711] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:50 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:04:50.927861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:50.928495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:50.935013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.935457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:50.936209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:50.936664 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:51.290430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:51.298813 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f2e61fbe-383a-4732-a715-a907f5ef085d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.375736 Jul 07 04:04:51.299532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 344/712] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:50 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:51.754579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:51.755115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:51.761603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:51.762056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:51.762819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:51.763264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:51.822762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:51.830036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-50037fc9-2ccf-432e-aef0-b33882ecb827 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1145 microversion: 2.1 time: 0.080127 Jul 07 04:04:51.830756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 369/713] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:51 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:51.858700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:51.859304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:51.866476 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:51.866919 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:51.867668 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:51.868099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:51.882432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:51.996875 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:52.005901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:52.007317 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:52.008504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4c126ad7-48d0-423d-8808-9d210c024240 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.153682 Jul 07 04:04:52.009069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 345/714] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:51 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:52.317006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:52.317622 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:52.325092 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:52.325719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:52.326494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:52.327287 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:52.457031 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:52.464838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c9ddd4b4-7638-46db-b24a-ccf219c0385c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.152378 Jul 07 04:04:52.465396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 370/715] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:52 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:52.847357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:52.847968 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:52.854086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:52.854535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:52.855291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:52.855726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:52.915889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:52.923254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-232aa95f-50f2-463a-a0b1-c132b547fdb6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1193 microversion: 2.1 time: 0.080557 Jul 07 04:04:52.923826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 346/716] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:52 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:53.026811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:53.027421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:53.034717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.035163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:53.035919 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.036389 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:53.167684 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:53.176180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:53.177710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:53.178844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8196c90a-efd5-473f-985c-b940dc58fa88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.155876 Jul 07 04:04:53.179403 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 371/717] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:53 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:53.482945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:53.483553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:53.490519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.491027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:53.491784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.492214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:53.617948 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:53.625790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-733a1337-0c52-412e-962f-8143a25b2669 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.146668 Jul 07 04:04:53.626360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 347/718] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:53 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:53.941081 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:53.941689 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:53.947599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.948071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:53.948942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:53.949378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:54.010939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:54.018985 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2fc340a0-0e64-4333-99c8-8d6981f522ed tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1193 microversion: 2.1 time: 0.081574 Jul 07 04:04:54.019478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 372/719] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:53 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:54.197532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:54.198143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:54.204614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:54.205671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:54.206549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:54.206985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:54.336265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:54.344558 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:54.346830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:54.347978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6f70d6fc-aa21-4c7b-9889-1f061e864da6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.154503 Jul 07 04:04:54.348610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 348/720] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:54 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:54.643516 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:54.644114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:54.650627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:54.651069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:54.651848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:54.652299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:54.786330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:54.794378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2260d748-6286-46db-a88c-c014f3632b57 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.155308 Jul 07 04:04:54.794953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 373/721] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:54 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:55.036112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:55.036748 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:55.042794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.043237 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.043986 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.044454 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.108051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:55.116362 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4cf1bd97-0f8a-462f-bc96-7489d11c0d49 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1211 microversion: 2.1 time: 0.084727 Jul 07 04:04:55.116939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 349/722] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:55 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:55.366218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:55.366828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:55.372842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.373288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.374037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.374472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.502183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:55.510413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:55.511891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:55.513099 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-71f54055-98c9-4d28-9f01-a191a5325f1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.150730 Jul 07 04:04:55.513651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 374/723] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:55 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:55.811893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:55.812704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:55.819625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.820073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.820872 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:55.821305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:55.953152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:55.962192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-682c28ca-2199-49e4-8a56-757157b68f17 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.154167 Jul 07 04:04:55.962766 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 350/724] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:55 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:56.133169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:56.133713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:56.140074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.140552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:56.141305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.141745 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:56.207487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:56.214834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c4da34b3-6130-4ec6-9e84-3b15e1dcbfda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1211 microversion: 2.1 time: 0.085548 Jul 07 04:04:56.215407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 375/725] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:56 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:56.531278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:56.532039 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:56.539292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.539847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:56.540849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.541372 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:56.671250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:56.680410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:56.681914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:56.683085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-98069c15-36e6-479f-b462-dc3597e2cfb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.155975 Jul 07 04:04:56.683648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 351/726] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:56 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:56.984229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:56.985431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:56.992464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.992913 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:56.993675 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:56.994112 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.154381 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:57.163191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ad890bab-738d-4a1a-b0db-ec1b726a9532 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.184015 Jul 07 04:04:57.163754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 376/727] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:56 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:57.232108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:57.232745 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:57.239562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:57.240115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.240963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:57.241462 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.375382 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:57.383519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ef0def42-0f28-4ac4-a203-caec90a8b182 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1278 microversion: 2.1 time: 0.155304 Jul 07 04:04:57.384100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 352/728] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:57 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:57.705314 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:57.717530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:57.725765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:57.727740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.729416 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:57.729957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.880685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-30496c0b-2ad9-4857-a4a6-1452d9f846f8 req-f59d6a50-9353-4395-ac02-7ab571e01bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc26698e-e0d0-4fd6-8cc1-607d89ebb414", "tag": "a980d17b-ea5d-4119-a9c8-03335bf8492a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:57.890082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:57.890602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-30496c0b-2ad9-4857-a4a6-1452d9f846f8 req-f59d6a50-9353-4395-ac02-7ab571e01bb9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:57.891241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-30496c0b-2ad9-4857-a4a6-1452d9f846f8 req-f59d6a50-9353-4395-ac02-7ab571e01bb9 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:57.902762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:57.904348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:57.904903 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-30496c0b-2ad9-4857-a4a6-1452d9f846f8 req-f59d6a50-9353-4395-ac02-7ab571e01bb9 service nova] Creating event network-changed:a980d17b-ea5d-4119-a9c8-03335bf8492a for instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 on hv-cinder-84684 Jul 07 04:04:57.905670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a04f139f-b371-4b43-87bc-b65b3dc3f1e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.207353 Jul 07 04:04:57.907203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 377/729] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:57 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:57.910930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-30496c0b-2ad9-4857-a4a6-1452d9f846f8 req-f59d6a50-9353-4395-ac02-7ab571e01bb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200596 Jul 07 04:04:57.911650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 353/730] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:04:58.180541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:58.181153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:58.187493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.187928 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:58.188722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.189157 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:58.325202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:58.333318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4640e76b-0122-494f-8061-752e6352efce tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1735 microversion: 2.1 time: 0.156745 Jul 07 04:04:58.333879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 378/731] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:58 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:58.401673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:58.402372 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:58.408688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.409117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:58.409871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.410304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:58.541942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:58.550283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-af72a898-3b2c-4b13-9472-620376ed8a01 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.153230 Jul 07 04:04:58.550851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 354/732] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:58 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:58.925592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:58.926315 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:58.932229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.932713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:58.933460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:58.933890 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.075544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.083840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.085352 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.086494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6226694f-f01f-41ee-9ad5-9f448de85aa8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.165112 Jul 07 04:04:59.087054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 379/733] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:04:58 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:04:59.351373 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:59.352019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:59.358034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.358481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.359241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.359677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.487456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.495294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-447c2f4f-f9af-437e-ab7a-ec96f98b4f9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1715 microversion: 2.1 time: 0.147773 Jul 07 04:04:59.495860 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 355/734] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:59 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:04:59.566792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:59.567411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:59.573692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.574145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.574909 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.575342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.598795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:59.599299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:59.605359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.605743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.606502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.606936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.688594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] HTTP exception thrown: Cannot 'detach_volume' instance c9e14bc5-d51a-4264-a422-1061afe5509a while it is in vm_state rescued Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Request method failure captured: Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments/79f04473-6ec6-44d0-9d68-9f49fbf6213f HTTP/1.1 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnmzgznEnKqXoLQwL30BYHLzrx2cb07X8tvx1sQEaVckelNF3TnqHp9A1MyvtzCSKyMXeeKjY_4kaDIwIRoIhUzcHgb-pADoC34-MfZJW_aIRY_A-BSdHL0UPdyilawAG4LvhYKuq9mEGhdc86l8CYX3BO3kptwMnI_XZRJDNKoBb8 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:04:59.690534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: d8caa40d03dc43acb66dd7d6c128a61b Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:04:59.692157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Cannot 'detach_volume' instance c9e14bc5-d51a-4264-a422-1061afe5509a while it is in vm_state rescued Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'server_id': 'c9e14bc5-d51a-4264-a422-1061afe5509a', 'id': '79f04473-6ec6-44d0-9d68-9f49fbf6213f'} Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9e14bc5-d51a-4264-a422-1061afe5509a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:04:59.692974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c9e14bc5-d51a-4264-a422-1061afe5509a while it is in vm_state rescued Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c9e14bc5-d51a-4264-a422-1061afe5509a while it is in vm_state rescued Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:04:59.694436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Returning 409 to user: Cannot 'detach_volume' instance c9e14bc5-d51a-4264-a422-1061afe5509a while it is in vm_state rescued {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:04:59.695725 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0e353e91-6f51-4add-836c-c2de61956234 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments/79f04473-6ec6-44d0-9d68-9f49fbf6213f" status: 409 len: 152 microversion: 2.1 time: 0.099058 Jul 07 04:04:59.695725 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 356/735] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:04:59 2022] DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments/79f04473-6ec6-44d0-9d68-9f49fbf6213f => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 04:04:59.700353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:04:59.700887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:59.707631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.708081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.709319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.709319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.720741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.728427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7dea2669-1477-4773-9c28-9d19e10f6524 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.165425 Jul 07 04:04:59.729071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 380/736] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:59 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:04:59.774319 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5063befc-6e11-48d8-a828-f39315fbdce7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/action" status: 202 len: 0 microversion: 2.1 time: 0.077399 Jul 07 04:04:59.774938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 357/737] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:04:59 2022] POST /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:04:59.783032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:04:59.783720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:04:59.789952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.790407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.791168 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:04:59.791612 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:04:59.918041 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:04:59.926475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f46b64d5-33ec-484c-ba87-a3caa905064b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.147321 Jul 07 04:04:59.927054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 381/738] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:04:59 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:00.105299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:00.106004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:00.112141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.112619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:00.113378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.113816 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:00.244295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:00.253299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:00.254806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:00.255966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-902799a8-ef2b-446b-a7ce-594381b01e2a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.154928 Jul 07 04:05:00.256552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 358/739] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:00 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:00.746190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:00.746802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:00.754104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.754553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:00.755325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.755766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:00.885785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:00.893203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-17c36d63-a458-47cf-8c3a-5e8f6fe54f24 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.150816 Jul 07 04:05:00.893793 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 382/740] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:00 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:00.944716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:00.945369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:00.951891 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.952374 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:00.953140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:00.953577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:01.083951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:01.092233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1299d3b7-b1e6-4048-883f-52a0129a3ab1 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.151398 Jul 07 04:05:01.092829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 359/741] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:00 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:01.273769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:01.274304 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:01.280251 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:01.280730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:01.281484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:01.281920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:01.421076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:01.429402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:01.430900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:01.432049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-420f41d8-3996-4220-a750-a28d8e5f9f31 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.162220 Jul 07 04:05:01.432647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 383/742] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:01 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:01.910064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:01.910602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:01.917074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:01.917520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:01.918279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:01.918722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:02.048041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:02.056080 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-482da261-377b-493a-9466-844f07e6b49a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.150162 Jul 07 04:05:02.056686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 360/743] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:01 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:02.110382 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:02.111596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:02.118410 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:02.118859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:02.119615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:02.120051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:02.123885 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:02.257966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:02.265841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-10439a0d-3938-413f-9650-bf88e05d04cb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.159206 Jul 07 04:05:02.266408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 384/744] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:02 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:02.450322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:02.450447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:02.456387 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:02.456832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:02.457579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:02.458007 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:02.586214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:02.588526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:02.596487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:02.598076 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:02.599222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f6e59b2c-15f3-4269-b120-d2c4b7621621 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.153346 Jul 07 04:05:02.599780 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 361/745] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:02 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:03.073378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:03.074019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:03.080021 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.080517 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.081377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.082343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.212536 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:03.219848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7e506b5b-89d6-4822-aa12-d4b87451da1c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.150305 Jul 07 04:05:03.220429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 385/746] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:03 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:03.282896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:03.283559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:03.291603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.292054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.292834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.293266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.426008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:03.434107 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-132e631e-30ba-4bd7-9aff-438870574c1c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.154930 Jul 07 04:05:03.434688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 362/747] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:03 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:03.617405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:03.618010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:03.624003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.624484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.625233 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:03.625662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:03.755639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:03.763918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:03.765425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:03.766555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e9f0d362-bffc-4f16-a82b-22544ec4e79f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.153037 Jul 07 04:05:03.767103 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 386/748] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:03 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:04.239197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:04.240260 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:04.248304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.249012 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.249932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.251239 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.451329 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:04.451947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:04.460060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:04.467757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5482146c-112c-49f3-bbde-8b6adb36ee61 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.234277 Jul 07 04:05:04.469500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.470127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.470904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.471593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.472626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 363/749] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:04 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:04.662961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:04.670843 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6b204774-ccac-46ad-bc03-212401abd84c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.223663 Jul 07 04:05:04.671418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 387/750] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:04 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:05:04.786915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:04.787626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:04.793548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.793994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.794752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:04.795186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:04.927547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:04.935884 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:04.937413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:04.938561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-21f99ba1-f030-4a04-bfd8-e255ea74747e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.156223 Jul 07 04:05:04.939125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 364/751] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:04 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:05.488942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:05.489550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:05.495942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.496422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.497173 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.497605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.635969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:05.643259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b67eed78-2d27-4f39-8cca-135d1f166519 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.158105 Jul 07 04:05:05.644638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 388/752] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:05 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:05.687895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:05.688527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:05.695268 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.695708 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.696585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.697018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.773194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-9f63a5f7-3eba-4df1-9d02-c19189533659 req-47623537-f286-417b-9f6d-3bde13feb0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "name": "network-vif-plugged", "status": "completed", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:05.781278 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9f63a5f7-3eba-4df1-9d02-c19189533659 req-47623537-f286-417b-9f6d-3bde13feb0a5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.781718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9f63a5f7-3eba-4df1-9d02-c19189533659 req-47623537-f286-417b-9f6d-3bde13feb0a5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.797040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-9f63a5f7-3eba-4df1-9d02-c19189533659 req-47623537-f286-417b-9f6d-3bde13feb0a5 service nova] Creating event network-vif-plugged:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 04:05:05.804218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-9f63a5f7-3eba-4df1-9d02-c19189533659 req-47623537-f286-417b-9f6d-3bde13feb0a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035153 Jul 07 04:05:05.805005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 389/753] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:05:05.839473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:05.850017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b5922536-b874-4a1f-a191-b76ea16c1e70 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.165772 Jul 07 04:05:05.850614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 365/754] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:05 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:05.957995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:05.958805 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:05.964953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.965396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:05.966137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:05.966566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:06.092229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:06.101607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:06.103093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:06.104232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3a315683-ae9a-432d-a224-e0d9ba58ec6a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.151105 Jul 07 04:05:06.104811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 390/755] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:05 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:06.661330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:06.661874 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:06.667856 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:06.668316 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:06.669069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:06.669498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:06.799341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:06.806915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f5dbc442-5cbf-4027-977f-43f26f1c0982 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.150086 Jul 07 04:05:06.807472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 366/756] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:06 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:06.867292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:06.867899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:06.874438 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:06.874883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:06.875637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:06.876077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:07.006511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:07.014334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d5990ac6-bdaa-43f7-842b-bec048bd5b45 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.151079 Jul 07 04:05:07.014881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 391/757] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:06 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:07.122783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:07.123397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:07.130027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:07.130496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:07.131249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:07.131680 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:07.259128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:07.267457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:07.268979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:07.270946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9b817e57-d04f-4952-9c62-3714e5ec0daa tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.151942 Jul 07 04:05:07.271502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 367/758] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:07 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:07.823531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:07.824141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:07.830145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:07.830592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:07.831355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:07.831789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:07.965546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:07.973211 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-97ef3815-8de7-4c3d-b616-509dc0c9c8e0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.153507 Jul 07 04:05:07.974174 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 392/759] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:07 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:08.032224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:08.032988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:08.039482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.039999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:08.040847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.041344 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:08.091772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-09ce0e46-7bf3-4754-8802-2fab03e2e721 req-dc61d509-4fab-4bdb-970c-b5e842868a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc26698e-e0d0-4fd6-8cc1-607d89ebb414", "name": "network-vif-plugged", "status": "completed", "tag": "a980d17b-ea5d-4119-a9c8-03335bf8492a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:08.100260 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-09ce0e46-7bf3-4754-8802-2fab03e2e721 req-dc61d509-4fab-4bdb-970c-b5e842868a1c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.100750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-09ce0e46-7bf3-4754-8802-2fab03e2e721 req-dc61d509-4fab-4bdb-970c-b5e842868a1c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:08.113904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-09ce0e46-7bf3-4754-8802-2fab03e2e721 req-dc61d509-4fab-4bdb-970c-b5e842868a1c service nova] Creating event network-vif-plugged:a980d17b-ea5d-4119-a9c8-03335bf8492a for instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 on hv-cinder-84684 Jul 07 04:05:08.119520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-09ce0e46-7bf3-4754-8802-2fab03e2e721 req-dc61d509-4fab-4bdb-970c-b5e842868a1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Jul 07 04:05:08.120355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 393/760] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:05:08.177755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:08.185926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-26de4f68-2285-4ead-b9b4-28d70eee61e0 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1723 microversion: 2.1 time: 0.157517 Jul 07 04:05:08.186491 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 368/761] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:08 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:08.289925 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:08.290634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:08.296973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.297419 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:08.298179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.298621 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:08.433460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:08.450206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:08.451727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:08.452970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fcc66297-98bc-4642-95ab-94cc7df27872 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.167903 Jul 07 04:05:08.453533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 394/762] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:08 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:08.990339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:08.992101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:08.999429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:08.999877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.000673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.001109 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.134207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:09.141652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-98cf1255-5e8d-4744-b9ef-348481bac4ba tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.155535 Jul 07 04:05:09.142242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 369/763] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:08 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:09.203038 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:09.203826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:09.212015 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.212702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.213371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.213813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.347955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:09.355766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d8ff76b1-da89-4884-a604-d3a800b46360 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1729 microversion: 2.1 time: 0.156614 Jul 07 04:05:09.356348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 395/764] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:09 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:09.372889 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:09.373379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:09.379790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.380253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.381193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.381626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.458510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e363e8c0-51f4-4177-ba46-de9745738d50 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089359 Jul 07 04:05:09.459104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 370/765] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:05:09 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:05:09.471111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:09.471728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:09.478753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.479198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.479988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:09.480499 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:09.709883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:09.718178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:09.719619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:09.720806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9b40bf52-48de-4871-b881-ca1f7f32db2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.253867 Jul 07 04:05:09.721628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 396/766] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:09 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:10.159457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:10.160100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:10.166425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:10.166857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:10.167656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:10.168093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:10.547804 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:10.555647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7dc8be9d-b1da-476c-a5f7-9e0c4e314ff1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1266 microversion: 2.1 time: 0.400592 Jul 07 04:05:10.556449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 371/767] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:10 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:10.740310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:10.741223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:10.747693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:10.748215 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:10.749079 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:10.749576 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:10.758828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-35e578f3-7354-44f1-99fd-6b9b0a62f5e8 req-08571cd0-63fb-494e-9a71-ac7ba5047af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:10.767472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-35e578f3-7354-44f1-99fd-6b9b0a62f5e8 req-08571cd0-63fb-494e-9a71-ac7ba5047af1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:10.767917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-35e578f3-7354-44f1-99fd-6b9b0a62f5e8 req-08571cd0-63fb-494e-9a71-ac7ba5047af1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:10.780153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-35e578f3-7354-44f1-99fd-6b9b0a62f5e8 req-08571cd0-63fb-494e-9a71-ac7ba5047af1 service nova] Creating event network-changed:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:05:10.786038 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-35e578f3-7354-44f1-99fd-6b9b0a62f5e8 req-08571cd0-63fb-494e-9a71-ac7ba5047af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096197 Jul 07 04:05:10.788471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 397/768] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:05:10.888286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:10.897183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:10.898688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:10.899845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d79bd9ae-09ae-4c9a-8ea2-01d15f6fafb9 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.163477 Jul 07 04:05:10.900428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 372/769] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:10 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:05:11.087614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:05:11.087831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:05:11.572895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:11.573606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:11.580194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.580611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:11.581376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.581815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:11.713655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:11.721529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f3380c08-c38e-4d1a-8f08-1cda1c3648bb tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1454 microversion: 2.1 time: 0.152501 Jul 07 04:05:11.722086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 398/770] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:11 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:11.738088 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:11.738728 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:11.745482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.745927 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:11.746676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.747108 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:11.874999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:11.882667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ca3dbe93-dd40-4aae-84df-c6b398d620e9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1454 microversion: 2.1 time: 0.148290 Jul 07 04:05:11.883229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 373/771] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:11 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:11.918376 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:11.918984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:11.925670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.926182 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:11.927071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:11.927508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:12.092639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:12.105606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:12.107445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:12.108662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-95cae469-5cc0-4c4e-ae43-0e3b4d172743 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1809 microversion: 2.20 time: 0.194383 Jul 07 04:05:12.109467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 399/772] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:11 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:12.810027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-7b4269f9-9a2e-4b91-99d3-cbc61f046775 req-6cbf1ae0-033a-411a-813c-65f8686f088a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:12.820821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-7b4269f9-9a2e-4b91-99d3-cbc61f046775 req-6cbf1ae0-033a-411a-813c-65f8686f088a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:12.821666 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-7b4269f9-9a2e-4b91-99d3-cbc61f046775 req-6cbf1ae0-033a-411a-813c-65f8686f088a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:12.834490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-7b4269f9-9a2e-4b91-99d3-cbc61f046775 req-6cbf1ae0-033a-411a-813c-65f8686f088a service nova] Creating event network-changed:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:05:12.840538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-7b4269f9-9a2e-4b91-99d3-cbc61f046775 req-6cbf1ae0-033a-411a-813c-65f8686f088a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Jul 07 04:05:12.841535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 374/773] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:05:13.126987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:13.127660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:13.134746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:13.135223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:13.135973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:13.136437 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:13.435093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:13.443950 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:13.445831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:13.447434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-656ece5e-485b-4b21-82ee-abfbaa9e66e7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1796 microversion: 2.20 time: 0.324311 Jul 07 04:05:13.448606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 400/774] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:05:13 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1796 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:05:14.857248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-b06001bb-34fb-4420-9906-1e37c2af7c73 req-e1dc253c-f7f4-4398-a43b-05c2427cb6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc26698e-e0d0-4fd6-8cc1-607d89ebb414", "tag": "a980d17b-ea5d-4119-a9c8-03335bf8492a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:14.866158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-b06001bb-34fb-4420-9906-1e37c2af7c73 req-e1dc253c-f7f4-4398-a43b-05c2427cb6d3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:14.866609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-b06001bb-34fb-4420-9906-1e37c2af7c73 req-e1dc253c-f7f4-4398-a43b-05c2427cb6d3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:14.878406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-b06001bb-34fb-4420-9906-1e37c2af7c73 req-e1dc253c-f7f4-4398-a43b-05c2427cb6d3 service nova] Creating event network-changed:a980d17b-ea5d-4119-a9c8-03335bf8492a for instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 on hv-cinder-84684 Jul 07 04:05:14.883534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-b06001bb-34fb-4420-9906-1e37c2af7c73 req-e1dc253c-f7f4-4398-a43b-05c2427cb6d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030886 Jul 07 04:05:14.884152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 375/775] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:05:17.751989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:17.752561 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:17.755699 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=82 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:17.760856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:17.761291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:17.762047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:17.762484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:17.841647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lazy-loading 'services' on Instance uuid 46a0e9ce-7bb6-48e1-91d6-c339089593b5 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:05:17.913602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ba783711-10b5-48ef-8319-4fe349519052 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments/3064fca9-fc0c-46f3-b3b3-d0e871c6279c" status: 202 len: 0 microversion: 2.1 time: 0.165442 Jul 07 04:05:17.914286 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 401/776] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:05:17 2022] DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments/3064fca9-fc0c-46f3-b3b3-d0e871c6279c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:05:20.084051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-78ac0c5c-8f83-41ed-ab7e-cd535ea11f0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:20.091047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-78ac0c5c-8f83-41ed-ab7e-cd535ea11f0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:20.091496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-78ac0c5c-8f83-41ed-ab7e-cd535ea11f0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:20.114481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-78ac0c5c-8f83-41ed-ab7e-cd535ea11f0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Going to try to stop instance {{(pid=117995) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 04:05:20.155713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-78ac0c5c-8f83-41ed-ab7e-cd535ea11f0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action" status: 202 len: 0 microversion: 2.1 time: 0.075678 Jul 07 04:05:20.156559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 376/777] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:05:20 2022] POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:05:20.165908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:20.166605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:20.173825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:20.174277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:20.175295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:20.176256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:20.180447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:20.312779 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:20.320418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ce875ef2-07d8-4e21-a3f4-b8492fc3e277 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.159185 Jul 07 04:05:20.320920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 402/778] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:20 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:21.338595 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:21.339348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:21.341688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=68 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:21.347990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:21.348730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:21.349498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:21.349931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:21.479520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:21.486974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7be4d989-fc5e-43d5-852e-dc03e616c9ee tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.152612 Jul 07 04:05:21.487534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 377/779] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:21 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:22.505417 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:22.506027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:22.513367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:22.513367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:22.513986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:22.514421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:22.647229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:22.654873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-772145ef-3e41-437b-af5d-013e559a7927 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.153744 Jul 07 04:05:22.655487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 403/780] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:22 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:23.672125 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:23.672755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:23.679619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:23.680060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:23.680848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:23.681281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:23.813198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:23.820835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-25232f91-c053-4e86-ae72-8dbcf792e463 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.152570 Jul 07 04:05:23.821407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 378/781] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:23 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:24.837886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:24.838502 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:24.844713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:24.845166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:24.846181 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:24.846616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:24.976226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:24.983563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e8a5e398-ae48-42f4-95d5-2b8331d481cb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.149483 Jul 07 04:05:24.984121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 404/782] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:24 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:26.001417 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:26.002031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:26.008640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:26.009086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:26.009842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:26.010277 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:26.014116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:26.142422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:26.149936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5882aac5-c1b3-4ebc-9afd-11c1fcfcc689 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.152564 Jul 07 04:05:26.150530 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 379/783] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:25 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:27.166942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:27.167551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:27.173899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:27.174346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:27.175095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:27.176310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:27.306214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:27.314079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-65bd78ea-8d1f-4b9e-8e9e-4cad0680ad8b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.150948 Jul 07 04:05:27.314649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 405/784] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:27 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:28.331034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:28.331649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:28.338404 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:28.338845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:28.339594 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:28.340024 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:28.469256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:28.477691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f7dda3c9-eaad-47e0-ada2-2a8e5f95fefb tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.150497 Jul 07 04:05:28.478256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 380/785] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:28 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:29.494696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:29.495305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:29.501724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:29.502167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:29.502913 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:29.503851 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:29.632735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:29.641328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e3c5285f-f126-4b2b-a02f-4d1b957dc682 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.150343 Jul 07 04:05:29.641997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 406/786] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:29 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:30.658755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:30.659365 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:30.666650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:30.667099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:30.667852 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:30.668310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:30.794206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:30.802197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-35eedfdc-207b-406a-b9fd-4cd546eb561e tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.146653 Jul 07 04:05:30.802779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 381/787] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:30 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:31.819849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:31.820494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:31.826837 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:31.827283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:31.828032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:31.828491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:31.954294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:31.962120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8ad91a9b-1d92-4ef6-a8bc-3d8f6549d95f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.146875 Jul 07 04:05:31.962681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 407/788] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:31 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:32.979275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:32.979911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:32.986376 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:32.986819 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:32.987571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:32.988005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:33.340983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:33.349253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-abedfe00-3f65-4b70-94ba-3615e4f3d831 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.373356 Jul 07 04:05:33.349820 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 382/789] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:32 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:34.366733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:34.367348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:34.373784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:34.374234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:34.374988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:34.375425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:34.507440 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:34.515620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b5f23bfd-57d8-4905-905a-a7a791d78a3c tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.152835 Jul 07 04:05:34.516189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 408/790] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:34 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:35.533105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:35.533710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:35.540904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:35.541344 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:35.542091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:35.542520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:35.676500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:35.684126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-03965985-85b9-42f4-961b-4d9874eb8a4a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1678 microversion: 2.1 time: 0.154850 Jul 07 04:05:35.684742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 383/791] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:35 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:36.701616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:36.702242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:36.708541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:36.708992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:36.709747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:36.710943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:36.838200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:36.846024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e491c7a2-da34-4128-b39f-22712cbeac89 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1655 microversion: 2.1 time: 0.148269 Jul 07 04:05:36.846597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 409/792] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:36 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:05:36.864136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7f56791e-ee12-4054-9406-a152110b3b19 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:36.871557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f56791e-ee12-4054-9406-a152110b3b19 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:36.872007 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f56791e-ee12-4054-9406-a152110b3b19 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:36.894485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7f56791e-ee12-4054-9406-a152110b3b19 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Going to try to start instance {{(pid=117995) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 04:05:36.940779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7f56791e-ee12-4054-9406-a152110b3b19 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action" status: 202 len: 0 microversion: 2.1 time: 0.080676 Jul 07 04:05:36.941602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 384/793] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:05:36 2022] POST /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:05:36.951594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:36.952371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:36.959238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:36.959789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:36.961446 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:36.962896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:37.123969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:37.133595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55d5bb92-37c7-4efb-a885-4169c3d365df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1664 microversion: 2.1 time: 0.185978 Jul 07 04:05:37.134616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 410/794] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:36 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:05:38.152388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:38.153160 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:38.160805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:38.161292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:38.162089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:38.162524 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:38.298953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:38.307071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6170b90d-ef79-474e-88a9-7b5a579264b5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1664 microversion: 2.1 time: 0.159147 Jul 07 04:05:38.307653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 385/795] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:38 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:39.325716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:39.326305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:39.332778 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:39.333226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:39.333979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:39.334412 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:39.462900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:39.470226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c7c19f4-f9fc-4ae8-b0eb-4f79b7b8cf3d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1668 microversion: 2.1 time: 0.148435 Jul 07 04:05:39.471050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 411/796] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:39 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:05:59.006714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:05:59.007322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:59.009640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=17 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:59.010297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:59.016405 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:59.016855 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:59.017625 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:59.018066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:59.042803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lazy-loading 'flavor' on Instance uuid 153a1cb5-acd7-4aad-b5e4-c7930015786f {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:05:59.112632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-81d96281-01e8-4d54-94c9-7d3b15068ef3 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "POST /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f/action" status: 202 len: 0 microversion: 2.1 time: 0.109726 Jul 07 04:05:59.113240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 386/797] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:05:59 2022] POST /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 04:05:59.121601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:05:59.122215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:05:59.124461 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=21 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:59.125112 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=59 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:59.130523 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:59.130986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:59.131751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:05:59.132204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:05:59.270215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:05:59.278283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-49e6adba-618e-436b-acbe-09846d8928b6 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.160762 Jul 07 04:05:59.278852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 412/798] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:05:59 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:00.297270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:00.297973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:00.304222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:00.304697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:00.305459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:00.305894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:00.439487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:00.447047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2526a490-a4b6-43e4-8d1f-ca7d72e022af tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.154499 Jul 07 04:06:00.447612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 387/799] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:00 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:01.464587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:01.465137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:01.471801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:01.472241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:01.473007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:01.473436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:01.604597 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:01.612111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2caf863a-a50f-489e-bbee-0a8e043946b5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.151529 Jul 07 04:06:01.612706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 413/800] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:01 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:02.629244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:02.629857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:02.637005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:02.637448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:02.638193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:02.638620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:02.766692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:02.774104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e79b712f-023f-4701-81f1-7b0de7ae5660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.148737 Jul 07 04:06:02.774661 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 388/801] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:02 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:03.790275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:03.790823 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:03.797441 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:03.797892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:03.798657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:03.799090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:03.928363 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:03.935772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-948098a1-bca7-4cd8-b33c-f781daf297f0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.149591 Jul 07 04:06:03.936366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 414/802] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:03 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:04.952833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:04.953435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:04.959866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:04.960335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:04.961086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:04.961515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:05.092244 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:05.100151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bf7d2307-83ab-43e8-9d9c-6935bd62fc3a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.150892 Jul 07 04:06:05.100911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 389/803] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:04 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:06.118142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:06.118786 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:06.125386 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:06.125844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:06.126615 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:06.127055 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:06.257551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:06.264972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-165874ea-831e-4078-8c24-7fdb2bf0e7c9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.150886 Jul 07 04:06:06.265549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 415/804] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:06 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:07.283119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:07.283714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:07.290217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:07.290667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:07.291421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:07.291853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:07.423945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:07.432174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fca09c35-f6f2-423a-bc87-1826489d1c6d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.152945 Jul 07 04:06:07.432765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 390/805] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:07 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:08.449570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:08.450076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:08.456523 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:08.456971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:08.457706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:08.458140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:08.591665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:08.599285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-816a8785-d1a2-468a-9d5b-f2edddaa42a4 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.153678 Jul 07 04:06:08.599972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 416/806] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:08 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:09.616512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:09.617241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:09.623909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:09.624396 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:09.625165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:09.625600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:09.763073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:09.770772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-91df9346-a2ef-4af3-a771-53fcd63864ae tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.158336 Jul 07 04:06:09.771357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 391/807] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:09 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:10.786818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:10.787964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:10.794639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:10.795086 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:10.795842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:10.796294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:10.926046 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:10.933501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b9d4631-7342-44fb-a2c9-de261c69c884 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.150535 Jul 07 04:06:10.934067 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 417/808] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:10 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:11.950348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:11.950959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:11.957461 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:11.957887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:11.958634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:11.959118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:12.091715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:12.100118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2c778d3f-0a88-4c75-abab-0a474d1036fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.153095 Jul 07 04:06:12.100724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 392/809] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:11 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:13.117750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:13.118291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:13.124781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.125228 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.125979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.126413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.261948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:13.269495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4e6598b2-b305-4307-8e61-6c125dcd4660 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1569 microversion: 2.1 time: 0.156313 Jul 07 04:06:13.270288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 418/810] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:13 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:13.286699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:06:13.287411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:13.294128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.294576 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.295350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.295785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.377315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-22dedafd-e6f3-4c4c-bec1-71349415268c tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "POST /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f/action" status: 202 len: 0 microversion: 2.1 time: 0.094465 Jul 07 04:06:13.377887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 393/811] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:06:13 2022] POST /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:06:13.386459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:13.387067 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:13.393069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.393509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.394260 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:13.394687 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:13.544863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:13.552292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9d33c0a3-05c3-4eba-82c0-e968996e8c4f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1517 microversion: 2.1 time: 0.169549 Jul 07 04:06:13.553614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 419/812] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:13 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:14.305519 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-dae45761-cccf-41ef-a9d5-d65c7976b66f req-a110dbc7-9a39-4021-a803-7d293562540f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "name": "network-vif-unplugged", "status": "completed", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:06:14.314575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-dae45761-cccf-41ef-a9d5-d65c7976b66f req-a110dbc7-9a39-4021-a803-7d293562540f service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:14.315029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-dae45761-cccf-41ef-a9d5-d65c7976b66f req-a110dbc7-9a39-4021-a803-7d293562540f service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:14.327385 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.compute.server_external_events [req-dae45761-cccf-41ef-a9d5-d65c7976b66f req-a110dbc7-9a39-4021-a803-7d293562540f service nova] Unable to find a host for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f. Dropping event network-vif-unplugged {{(pid=117995) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 04:06:14.328327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-dae45761-cccf-41ef-a9d5-d65c7976b66f req-a110dbc7-9a39-4021-a803-7d293562540f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027328 Jul 07 04:06:14.328918 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 394/813] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 07 04:06:14.570581 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:14.571200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:14.578300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:14.578752 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:14.579538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:14.579971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:14.715326 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:14.725426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18b6260d-33a7-41ea-bd9a-118e0b941a4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1519 microversion: 2.1 time: 0.159113 Jul 07 04:06:14.726175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 420/814] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:14 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:15.743077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:15.743682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:15.750127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:15.750571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:15.751321 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:15.751755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:15.883410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:15.890958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ad3eeb00-5031-4055-bc43-96614a0407b0 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.151809 Jul 07 04:06:15.891535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 395/815] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:15 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:16.907899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:16.908563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:16.915108 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:16.915555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:16.916345 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:16.916780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:17.048468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:17.056395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7ba0a910-9880-4e56-90c3-01667bfac38b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.152299 Jul 07 04:06:17.056962 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 421/816] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:16 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:18.074388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:18.075002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:18.081463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:18.081914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:18.082669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:18.083106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:18.217229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:18.225061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-33a83318-5db2-4bdd-94f8-13c9fc92758a tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.154547 Jul 07 04:06:18.225653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 396/817] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:18 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:19.242384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:19.243463 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:19.250903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:19.251350 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:19.252121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:19.252582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:19.385948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:19.393506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6fecd5a1-a627-40ea-b5ef-a8737602b4c8 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.155864 Jul 07 04:06:19.394065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 422/818] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:19 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:20.410584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:20.411190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:20.418100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:20.418548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:20.419301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:20.419755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:20.551342 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:20.559387 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-153434bc-fe92-47c0-9061-b9dc31e6c231 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.152629 Jul 07 04:06:20.559960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 397/819] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:20 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:21.673922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:21.674533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:21.681375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:21.681830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:21.682588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:21.683058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:21.811828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:21.819215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-56d8a53d-5c5e-4d03-a8f4-825920300782 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.246709 Jul 07 04:06:21.819785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 423/820] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:21 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:22.836469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:22.837112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:22.843529 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:22.843976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:22.845020 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:22.845457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:22.981413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:22.988860 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bef4171a-5490-4a88-82da-4d0c045b4945 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.156873 Jul 07 04:06:22.989435 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 398/821] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:22 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:24.006641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:24.007170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:24.013605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:24.014056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:24.014839 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:24.015273 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:24.146545 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:24.153992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c2fa32ce-35e9-4fa6-a746-e7c9c85f2b68 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.151286 Jul 07 04:06:24.154568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 424/822] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:24 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:25.171793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:25.172437 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:25.178475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:25.178920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:25.179683 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:25.180745 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:25.316869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:25.324909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8a5b12f2-c853-458f-99ce-d453856a7d4b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.157077 Jul 07 04:06:25.325497 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 399/823] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:25 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:26.342610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:26.343436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:26.349869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:26.350310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:26.351058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:26.351487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:26.487263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:26.495310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55201192-9716-436d-83a9-ca5650c7736f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.156481 Jul 07 04:06:26.495878 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 425/824] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:26 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:27.512376 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:27.512989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:27.519341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:27.519782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:27.520568 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:27.520999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:27.526035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:27.661988 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:27.670604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fe61446d-3798-4578-bee9-38fbe50b43fd tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.161967 Jul 07 04:06:27.671440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 400/825] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:27 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:28.688876 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:28.689483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:28.696456 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:28.696837 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:28.697579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:28.698008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:28.828378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:28.835740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b849065e-9c87-441d-9837-c7bcbe430372 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.150727 Jul 07 04:06:28.836430 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 426/826] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:28 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:28.968282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-2913abbc-0c23-4384-8744-2e945bc6da65 req-1e9bf225-da6a-4fb4-8ace-04046a40bc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "name": "network-vif-plugged", "status": "completed", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:06:28.982012 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-2913abbc-0c23-4384-8744-2e945bc6da65 req-1e9bf225-da6a-4fb4-8ace-04046a40bc8d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:28.983231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-2913abbc-0c23-4384-8744-2e945bc6da65 req-1e9bf225-da6a-4fb4-8ace-04046a40bc8d service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:28.995538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-2913abbc-0c23-4384-8744-2e945bc6da65 req-1e9bf225-da6a-4fb4-8ace-04046a40bc8d service nova] Creating event network-vif-plugged:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:06:29.001513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-2913abbc-0c23-4384-8744-2e945bc6da65 req-1e9bf225-da6a-4fb4-8ace-04046a40bc8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037244 Jul 07 04:06:29.002285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 401/827] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:06:29.853518 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:29.854130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:29.856427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=31 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:29.861658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:29.862101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:29.862843 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:29.863272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:29.868031 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=91 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:29.990200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:29.998094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ceb00fc-208f-48d4-b1e0-6eaa9d7db667 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.149139 Jul 07 04:06:29.998651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 427/828] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:29 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:31.015543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:31.016242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:31.018872 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=35 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:31.024254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:31.024717 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:31.025467 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:31.025900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:31.161949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:31.169563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0b76a2a4-b6c0-4a12-9913-ea144cb4f4ab tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1575 microversion: 2.1 time: 0.158208 Jul 07 04:06:31.170165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 402/829] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:31 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:32.186662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:06:32.187276 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:06:32.193838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:32.194283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:32.195039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:06:32.195680 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:06:32.323806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:06:32.331147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6968fb65-8597-48c8-9fbf-b4d1fe2fa5cc tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1562 microversion: 2.1 time: 0.148354 Jul 07 04:06:32.331712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 428/830] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:06:32 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:06:49.770609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:06:49.771130 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:06:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:07:07.386619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:07.387206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:07.389141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:07.389809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=12 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:07.395291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:07.395740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:07.396532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:07.396972 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:07.478188 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'services' on Instance uuid c9e14bc5-d51a-4264-a422-1061afe5509a {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:07:07.548198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ca55a7f5-e04b-4af0-bac0-eeb992db4269 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments/79f04473-6ec6-44d0-9d68-9f49fbf6213f" status: 202 len: 0 microversion: 2.1 time: 0.165955 Jul 07 04:07:07.548805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 403/831] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:07:07 2022] DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments/79f04473-6ec6-44d0-9d68-9f49fbf6213f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:07:07.559118 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:07.560121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:07.562217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:07.563068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=11 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:07.568724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:07.569175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:07.569966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:07.570388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:07.601187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-28406c62-a8bd-4bab-ac2c-8891c75185b7 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047832 Jul 07 04:07:07.601662 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 429/832] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:07:07 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:08.613659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:08.614735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:08.621401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:08.621849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:08.622605 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:08.623066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:08.651603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8659987e-6e65-4f57-a0d0-0ad8bfd28bdb tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jul 07 04:07:08.652153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 404/833] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:07:08 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:09.663016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:09.663963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:09.670515 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.670965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:09.671721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.672154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:09.700147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-13ff9f51-3e45-4dab-92e1-d5214c1b6a2e tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041010 Jul 07 04:07:09.700652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 430/834] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:07:09 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:07:09.776851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:09.777380 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:09.783751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.784199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:09.784981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.785412 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:09.810062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:07:09.882465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1078c6b4-4d1e-45e8-8c69-98c35139556f tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 204 len: 0 microversion: 2.1 time: 0.109591 Jul 07 04:07:09.883831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 405/835] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:07:09 2022] DELETE /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:07:09.891926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:09.892571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:09.898470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.898946 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:09.900312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:09.900749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:10.032485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:10.041154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d38289ae-12aa-4695-a9a6-7342a634aac3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1689 microversion: 2.1 time: 0.151887 Jul 07 04:07:10.041725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 431/836] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:09 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:11.059488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:11.060187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:11.066626 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.067067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.067821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.068252 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.126130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:11.126713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:11.133095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.134071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.134948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.135379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.165395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a358fa85-1680-4049-aa99-ba25c5054648 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments/f6cb400f-b5c8-4f9f-99e6-61d751e3fe83" status: 200 len: 194 microversion: 2.20 time: 0.042448 Jul 07 04:07:11.165990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 432/837] 10.222.0.20 () {60 vars in 1453 bytes} [Thu Jul 7 04:07:11 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments/f6cb400f-b5c8-4f9f-99e6-61d751e3fe83 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 04:07:11.202101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:11.210260 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6deaedad-01df-4ce3-a26e-cc4a3f690332 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1689 microversion: 2.1 time: 0.155526 Jul 07 04:07:11.210835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 406/838] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:11 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:11.230091 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:11.230582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:11.236541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.236987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.237731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.238160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.316563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lazy-loading 'services' on Instance uuid 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:07:11.389840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ff838301-43f8-4482-9abd-cec8f03acf2c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments/f6cb400f-b5c8-4f9f-99e6-61d751e3fe83" status: 202 len: 0 microversion: 2.20 time: 0.163935 Jul 07 04:07:11.390848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 433/839] 10.222.0.20 () {60 vars in 1456 bytes} [Thu Jul 7 04:07:11 2022] DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments/f6cb400f-b5c8-4f9f-99e6-61d751e3fe83 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:07:11.399186 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:11.400201 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:11.406347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.406795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.407554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:11.407996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:11.440386 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-79911473-3683-4fef-872b-9df2a3ec1b8d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044254 Jul 07 04:07:11.441472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 407/840] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jul 7 04:07:11 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 04:07:12.229110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:12.229718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:12.235830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:12.236294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:12.237044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:12.237471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:12.366647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:12.374248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-db65647d-aefd-4b0c-8238-ae7c74c417a3 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1689 microversion: 2.1 time: 0.149925 Jul 07 04:07:12.374816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 434/841] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:12 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:12.452634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:12.453561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:12.459978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:12.460475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:12.461246 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:12.462191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:12.491201 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-44dbb188-ebac-4adb-9730-55c3b30a5851 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042516 Jul 07 04:07:12.491685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 408/842] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jul 7 04:07:12 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 04:07:13.393972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:13.394587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:13.402044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.402493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.403259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.403697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.502969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:13.503894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:13.511199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.511653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.512597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.512936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.544174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e61a7e26-9138-4cfb-a100-066511aef00d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045025 Jul 07 04:07:13.544786 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 409/843] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jul 7 04:07:13 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:13.545324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:13.552888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-45561b83-778b-4dd5-bd1a-9d4a9e48591d tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1689 microversion: 2.1 time: 0.164043 Jul 07 04:07:13.553451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 435/844] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:13 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:13.613479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:13.613980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:13.620298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.620751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.621523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.621965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.646998 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:07:13.730542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d1494926-a0ff-43c8-b8d9-01436e17ab66 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 204 len: 0 microversion: 2.20 time: 0.120014 Jul 07 04:07:13.731377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 410/845] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jul 7 04:07:13 2022] DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 04:07:13.740821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:13.741423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:13.751462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.752177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.752973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.753698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.875932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-3dda7c28-d322-4764-ade9-31f8708cb271 req-182f1e74-1727-458b-aec2-1f89acaffa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e14bc5-d51a-4264-a422-1061afe5509a", "name": "network-vif-deleted", "tag": "137ec6b8-715e-4933-b935-028d6fb4ff29"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:13.884793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-3dda7c28-d322-4764-ade9-31f8708cb271 req-182f1e74-1727-458b-aec2-1f89acaffa45 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:13.885493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-3dda7c28-d322-4764-ade9-31f8708cb271 req-182f1e74-1727-458b-aec2-1f89acaffa45 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:13.896990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-3dda7c28-d322-4764-ade9-31f8708cb271 req-182f1e74-1727-458b-aec2-1f89acaffa45 service nova] Creating event network-vif-deleted:137ec6b8-715e-4933-b935-028d6fb4ff29 for instance c9e14bc5-d51a-4264-a422-1061afe5509a on hv-cinder-84684 Jul 07 04:07:13.902884 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-3dda7c28-d322-4764-ade9-31f8708cb271 req-182f1e74-1727-458b-aec2-1f89acaffa45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 Jul 07 04:07:13.904051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 411/846] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:13.923175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:13.931925 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:13.933496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:13.934646 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dc989aee-2b96-49e6-8269-c454a662aa27 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.198297 Jul 07 04:07:13.935202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 436/847] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:13 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:14.571871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:14.572619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:14.578990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:14.579447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:14.580217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:14.580681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:14.652784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:14.660726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5743c7fb-6b48-4e43-bf08-478a27012ede tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1621 microversion: 2.1 time: 0.094024 Jul 07 04:07:14.661583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 412/848] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:14 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1621 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:14.953267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:14.953806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:14.960215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:14.960708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:14.961464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:14.962055 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:15.112191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:15.121609 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:15.123283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:15.124547 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4c966a8a-bfab-4c5b-b4a7-0216070ce0c2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.175305 Jul 07 04:07:15.125122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 437/849] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:14 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:15.679034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:15.679650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:15.686772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:15.687221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:15.687979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:15.688450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:15.717965 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:15.718414 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:15.718857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'fault' on Instance uuid c9e14bc5-d51a-4264-a422-1061afe5509a {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:07:15.763379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:15.770844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-24c769bf-4049-4285-94a7-cdf098bead9b tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 200 len: 1335 microversion: 2.1 time: 0.095832 Jul 07 04:07:15.771406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 413/850] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:15 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:16.143472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:16.144084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:16.151834 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:16.152295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:16.153168 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:16.153604 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:16.304529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:16.312447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:16.313939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:16.315087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3c139d3e-3835-43ab-9a35-b9f98ce3689c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1724 microversion: 2.20 time: 0.175648 Jul 07 04:07:16.315641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 438/851] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:16 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:16.787011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:16.787730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: c9e14bc5-d51a-4264-a422-1061afe5509a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:16.794859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:16.795303 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:16.796065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:16.796522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:16.809609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] HTTP exception thrown: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Request method failure captured: Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a HTTP/1.1 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnmzgznEnKqXoLQwL30BYHLzrx2cb07X8tvx1sQEaVckelNF3TnqHp9A1MyvtzCSKyMXeeKjY_4kaDIwIRoIhUzcHgb-pADoC34-MfZJW_aIRY_A-BSdHL0UPdyilawAG4LvhYKuq9mEGhdc86l8CYX3BO3kptwMnI_XZRJDNKoBb8 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:07:16.811247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: d8caa40d03dc43acb66dd7d6c128a61b Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. Jul 07 04:07:16.812894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'c9e14bc5-d51a-4264-a422-1061afe5509a'} Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:07:16.813715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. Jul 07 04:07:16.814975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:16.816071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Returning 404 to user: Instance c9e14bc5-d51a-4264-a422-1061afe5509a could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:07:16.816071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-286ec4df-8e96-47dd-bdeb-cf50bc833d08 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a" status: 404 len: 111 microversion: 2.1 time: 0.029496 Jul 07 04:07:16.816071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 414/852] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:16 2022] GET /compute/v2.1/servers/c9e14bc5-d51a-4264-a422-1061afe5509a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:07:16.821629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-75e19573-e748-439e-931a-b2c5d25999fc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '.version_select at 0x7ff6554815e0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:16.845013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-75e19573-e748-439e-931a-b2c5d25999fc tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106691451" status: 202 len: 0 microversion: 2.1 time: 0.027083 Jul 07 04:07:16.853512 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 439/853] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jul 7 04:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106691451 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:07:16.904060 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-d88e6acc-ced6-4dfe-a1a9-33227a1ce46b req-e236147d-ac31-49d1-843e-f786ef64fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9f4c3-0b0f-4e41-84da-1db40ece44b4", "name": "network-vif-deleted", "tag": "bbfd43af-e65b-4b9b-8410-6c4a8d84f77f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:16.922656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d88e6acc-ced6-4dfe-a1a9-33227a1ce46b req-e236147d-ac31-49d1-843e-f786ef64fb84 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:16.924644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d88e6acc-ced6-4dfe-a1a9-33227a1ce46b req-e236147d-ac31-49d1-843e-f786ef64fb84 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:16.940217 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-d88e6acc-ced6-4dfe-a1a9-33227a1ce46b req-e236147d-ac31-49d1-843e-f786ef64fb84 service nova] Creating event network-vif-deleted:bbfd43af-e65b-4b9b-8410-6c4a8d84f77f for instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 on hv-cinder-84684 Jul 07 04:07:16.945482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-d88e6acc-ced6-4dfe-a1a9-33227a1ce46b req-e236147d-ac31-49d1-843e-f786ef64fb84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047055 Jul 07 04:07:16.946756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 415/854] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:17.335083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:17.335701 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:17.343364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:17.344056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:17.344857 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:17.345710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:17.380825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:17.381634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:17.382293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lazy-loading 'fault' on Instance uuid 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:07:17.429894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:17.441195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:17.443102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:17.444954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1996c492-47f5-4a38-aa9e-1a232c4b1900 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 200 len: 1371 microversion: 2.20 time: 0.114402 Jul 07 04:07:17.457399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 440/855] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:17 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:18.465137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:18.465831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:18.472209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:18.472680 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:18.473430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:18.473857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:18.487651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 HTTP/1.1 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:07:18.489267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:07:18.490996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '7fa9f4c3-0b0f-4e41-84da-1db40ece44b4'} Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:07:18.491969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:07:18.493390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:18.494674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:07:18.494674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-90fe7a0f-b324-440d-8d99-07136362a21f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 404 len: 111 microversion: 2.20 time: 0.031016 Jul 07 04:07:18.494674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 416/856] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:18 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:07:18.499952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0847f3d4-71f1-4688-aa33-9131064d04c4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '.version_select at 0x7ff65548e0d0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:18.517170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0847f3d4-71f1-4688-aa33-9131064d04c4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588716840" status: 204 len: 0 microversion: 2.20 time: 0.020952 Jul 07 04:07:18.517717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 441/857] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Jul 7 04:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588716840 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 04:07:19.164610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-01f4edf0-f47b-48cf-89aa-d0fd29916703 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: .version_select at 0x7ff6555cc5e0>, body: {"keypair": {"name": "tempest-keypair-1067589551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1Hq7GZE1fO+Dv2bltG9291NwkNbZRvU0U9rrhNL1afbGmhwLhtH7tF8KSs/MKW289eXj7Vnx9E6tU44QK5wQig8X9lW51VDXNroQ3sYBniqkT2epSZwXeYD2HWi+HLEA=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:19.178215 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-01f4edf0-f47b-48cf-89aa-d0fd29916703 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for project a43d47ba220e4705adeb85c31c6605e1. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:19.182514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-01f4edf0-f47b-48cf-89aa-d0fd29916703 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for user a5219f613f5b43d6978f2fe410ce4d4f and project a43d47ba220e4705adeb85c31c6605e1. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:19.207169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-01f4edf0-f47b-48cf-89aa-d0fd29916703 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046415 Jul 07 04:07:19.207750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 417/858] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Jul 7 04:07:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 04:07:19.842125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:19.842702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:19.849683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:19.850238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:19.851102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:19.851533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:19.876660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:07:19.951890 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b6c5093d-6499-4997-a16e-e3364b62bd3a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 204 len: 0 microversion: 2.1 time: 0.114328 Jul 07 04:07:19.953250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 442/859] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:07:19 2022] DELETE /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:07:19.962315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:19.963008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:19.969794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:19.970666 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:19.971440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:19.971871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:20.105962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:20.109583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:20.115265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c2160882-0aaa-4bfc-9aff-87d4cc0101e5 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1506 microversion: 2.1 time: 0.157663 Jul 07 04:07:20.115844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 418/860] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:19 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:20.722860 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-643606553", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1230e41-3120-493a-9865-eaee18c94e3f"}], "security_groups": [{"name": "tempest-securitygroup--1653341559"}], "key_name": "tempest-keypair-1067589551", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:20.824655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] validate_networks() for [('c1230e41-3120-493a-9865-eaee18c94e3f', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:07:21.132704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:21.133359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:21.141374 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:21.141823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:21.142592 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:21.143032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:21.298840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:07:21.299347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:07:21.299840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:07:21.300513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:07:21.300932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:07:21.312873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:21.313495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:21.314415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:21.314912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:21.330914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:21.336759 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for project a43d47ba220e4705adeb85c31c6605e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:21.339824 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fa59d8e1-bb6a-4819-b108-0eb26dd4e607 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 200 len: 1506 microversion: 2.1 time: 0.211607 Jul 07 04:07:21.340960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 419/861] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:21 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:21.345491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Getting quotas for user a5219f613f5b43d6978f2fe410ce4d4f and project a43d47ba220e4705adeb85c31c6605e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:21.357395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:07:21.359757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:07:21.407728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4085210c-c2c0-4fc5-a509-2efd0b2efb4f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.689732 Jul 07 04:07:21.413383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 443/862] 10.222.0.20 () {62 vars in 1187 bytes} [Thu Jul 7 04:07:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 04:07:21.419572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:21.420459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:21.496128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:21.505020 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:21.506542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:21.508000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-835b7ecc-a870-4918-b589-4064903c9895 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1281 microversion: 2.20 time: 0.093417 Jul 07 04:07:21.508769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 420/863] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:21 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:21.742190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-7567d501-10a6-4dac-a07b-acac070d2a1c req-ea550b55-89b2-4aac-a1d0-fb95c9dee4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf125a4-168a-440b-ac01-25e63c8b28c2", "name": "network-vif-deleted", "tag": "c39a5330-23dc-4933-bff6-af9149f63583"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:21.752589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7567d501-10a6-4dac-a07b-acac070d2a1c req-ea550b55-89b2-4aac-a1d0-fb95c9dee4cb service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:21.753226 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7567d501-10a6-4dac-a07b-acac070d2a1c req-ea550b55-89b2-4aac-a1d0-fb95c9dee4cb service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:21.766330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-7567d501-10a6-4dac-a07b-acac070d2a1c req-ea550b55-89b2-4aac-a1d0-fb95c9dee4cb service nova] Creating event network-vif-deleted:c39a5330-23dc-4933-bff6-af9149f63583 for instance eaf125a4-168a-440b-ac01-25e63c8b28c2 on hv-cinder-84684 Jul 07 04:07:21.772657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-7567d501-10a6-4dac-a07b-acac070d2a1c req-ea550b55-89b2-4aac-a1d0-fb95c9dee4cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034783 Jul 07 04:07:21.773339 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 444/864] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:22.356759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:22.357449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: eaf125a4-168a-440b-ac01-25e63c8b28c2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:22.364784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.365230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.365999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.366434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.379496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] HTTP exception thrown: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Request method failure captured: Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 HTTP/1.1 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnmzgznEnKqXoLQwL30BYHLzrx2cb07X8tvx1sQEaVckelNF3TnqHp9A1MyvtzCSKyMXeeKjY_4kaDIwIRoIhUzcHgb-pADoC34-MfZJW_aIRY_A-BSdHL0UPdyilawAG4LvhYKuq9mEGhdc86l8CYX3BO3kptwMnI_XZRJDNKoBb8 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:07:22.381038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: d8caa40d03dc43acb66dd7d6c128a61b Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. Jul 07 04:07:22.382557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'eaf125a4-168a-440b-ac01-25e63c8b28c2'} Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:07:22.383350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. Jul 07 04:07:22.384549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:22.386207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Returning 404 to user: Instance eaf125a4-168a-440b-ac01-25e63c8b28c2 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:07:22.386207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1cdeacd8-9584-415b-b980-6cb2c89ed157 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2" status: 404 len: 111 microversion: 2.1 time: 0.029735 Jul 07 04:07:22.386207 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 421/865] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:22 2022] GET /compute/v2.1/servers/eaf125a4-168a-440b-ac01-25e63c8b28c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:07:22.392114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:22.392739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:22.399272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.399720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.400500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.401105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.425400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:07:22.439338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:22.499307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d451f49d-3e1a-4c24-8ffc-9626b42f025a tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 204 len: 0 microversion: 2.1 time: 0.111085 Jul 07 04:07:22.499874 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 445/866] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:07:22 2022] DELETE /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:07:22.507664 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:22.508293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:22.514585 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.514970 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.515729 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.516161 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.527197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:22.527888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:22.533730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.534177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.534921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:22.535348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:22.619194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:22.628797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:22.630283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:22.631372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-00052bba-abc8-435c-bbfe-9d3ecbb847a8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1333 microversion: 2.20 time: 0.108381 Jul 07 04:07:22.632120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 446/867] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:22 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:07:22.680892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:22.689000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-defe2f24-596e-4b63-ba41-6c9d4992dfb4 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.185086 Jul 07 04:07:22.689570 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 422/868] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:22 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:23.650864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:23.651743 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:23.658392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:23.658756 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:23.659513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:23.659943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:23.706731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:23.707339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:23.714165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:23.714601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:23.715362 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:23.715792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:23.892882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:23.901172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:23.902840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:23.904051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-721fa7c5-eacf-4b70-8800-2f9f24ac34d0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.257205 Jul 07 04:07:23.905018 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 447/869] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:23 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:07:23.928805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:23.937943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7ce0c089-ad7c-4928-a116-cda6f64e81a2 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1520 microversion: 2.1 time: 0.234973 Jul 07 04:07:23.938765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 423/870] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:23 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:24.369458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-fd6f2e76-2312-4576-a0b3-fc75d9f5cecc req-6771024d-ba6e-4356-aad1-bddd706174bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a", "name": "network-vif-deleted", "tag": "0fdd7d34-50db-4d68-a4a1-6a2daac09518"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:24.386679 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fd6f2e76-2312-4576-a0b3-fc75d9f5cecc req-6771024d-ba6e-4356-aad1-bddd706174bc service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.389666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-fd6f2e76-2312-4576-a0b3-fc75d9f5cecc req-6771024d-ba6e-4356-aad1-bddd706174bc service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.427320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:24.428954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:24.434641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-fd6f2e76-2312-4576-a0b3-fc75d9f5cecc req-6771024d-ba6e-4356-aad1-bddd706174bc service nova] Creating event network-vif-deleted:0fdd7d34-50db-4d68-a4a1-6a2daac09518 for instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a on hv-cinder-84684 Jul 07 04:07:24.441896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.442635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.443657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.447153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.453587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-fd6f2e76-2312-4576-a0b3-fc75d9f5cecc req-6771024d-ba6e-4356-aad1-bddd706174bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079118 Jul 07 04:07:24.457911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 448/871] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:24.473827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-3f923792-51b2-4f1e-a848-fbb82a78d181 req-e8728480-1f9c-4091-93fc-1620ef90fcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:24.489503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3f923792-51b2-4f1e-a848-fbb82a78d181 req-e8728480-1f9c-4091-93fc-1620ef90fcfc service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.490049 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3f923792-51b2-4f1e-a848-fbb82a78d181 req-e8728480-1f9c-4091-93fc-1620ef90fcfc service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.503309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-3f923792-51b2-4f1e-a848-fbb82a78d181 req-e8728480-1f9c-4091-93fc-1620ef90fcfc service nova] Creating event network-changed:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:07:24.508342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-3f923792-51b2-4f1e-a848-fbb82a78d181 req-e8728480-1f9c-4091-93fc-1620ef90fcfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048944 Jul 07 04:07:24.509368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 449/872] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:24.526787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-33da6955-7ba0-48d8-90ab-9525f1e1d340 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103746 Jul 07 04:07:24.527375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 424/873] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:07:24 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:07:24.602239 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:24.602902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:24.611967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.619505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.627806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.628567 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.672135 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:07:24.757663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d912a8fe-de3d-49d6-a1b1-81d2086b1829 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 204 len: 0 microversion: 2.1 time: 0.159803 Jul 07 04:07:24.758177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 450/874] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:07:24 2022] DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 04:07:24.766638 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:24.767262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:24.773285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.773736 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.774496 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.774934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.909064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:24.922955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:24.924114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:24.936165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.936664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.938210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.938649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.947465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7c43c2ef-322b-4d7a-b5c6-3da4b14fecce tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1674 microversion: 2.1 time: 0.181608 Jul 07 04:07:24.959150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 425/875] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:24 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:24.966195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:24.966813 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:24.974412 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.975056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:24.975647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:24.976089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:25.008559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:25.009008 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:25.009455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lazy-loading 'fault' on Instance uuid 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:07:25.059474 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8caa40d03dc43acb66dd7d6c128a61b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aefc719b77147d28ed1830d755d4d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:25.066878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3d1c9201-cd79-43e6-ac94-abd6a3411d16 tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 200 len: 1311 microversion: 2.1 time: 0.104966 Jul 07 04:07:25.067450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 426/876] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:24 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:25.101421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:25.109751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:25.111394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:25.112516 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0d306ed5-56f3-449f-9404-bda65f15aea0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.193745 Jul 07 04:07:25.113082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 451/877] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:24 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:25.965455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:25.965985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:25.972874 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:25.973317 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:25.974068 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:25.974514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:26.084766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:26.085480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] [instance: 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:26.092498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:26.092954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:26.093725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:26.094163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:26.100981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:26.107944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] HTTP exception thrown: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. Jul 07 04:07:26.109134 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a5f0087c-f11e-4a37-980e-043c125296a9 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1674 microversion: 2.1 time: 0.148184 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Request method failure captured: Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a HTTP/1.1 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnmzgznEnKqXoLQwL30BYHLzrx2cb07X8tvx1sQEaVckelNF3TnqHp9A1MyvtzCSKyMXeeKjY_4kaDIwIRoIhUzcHgb-pADoC34-MfZJW_aIRY_A-BSdHL0UPdyilawAG4LvhYKuq9mEGhdc86l8CYX3BO3kptwMnI_XZRJDNKoBb8 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:07:26.109620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aefc719b77147d28ed1830d755d4d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 2aefc719b77147d28ed1830d755d4d8d Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1551275109 Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: d8caa40d03dc43acb66dd7d6c128a61b Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1551275109-project Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. Jul 07 04:07:26.111227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a'} Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:07:26.112065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. Jul 07 04:07:26.113670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:07:26.115019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 427/878] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:25 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:26.115111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] Returning 404 to user: Instance 99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:07:26.115111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-86cba2e5-a311-4b15-8f80-8c4116e3a59c tempest-ServerRescueNegativeTestJSON-1551275109 tempest-ServerRescueNegativeTestJSON-1551275109-project] 10.222.0.20 "GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a" status: 404 len: 111 microversion: 2.1 time: 0.030324 Jul 07 04:07:26.115111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 452/879] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:26 2022] GET /compute/v2.1/servers/99198ba9-d0d0-40a9-b0b3-f9f29bf4bf3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:07:26.130495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:26.131135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:26.137795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:26.138248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:26.139012 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:26.139455 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:26.271079 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:26.280401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:26.282062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:26.283266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-87fb161c-2399-448d-86a4-d44c72a95395 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.156414 Jul 07 04:07:26.283914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 428/880] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:26 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:27.126413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:27.127024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:27.133548 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:27.134271 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:27.135036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:27.136161 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:27.278605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:27.286022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a8f2ca02-1904-4216-821e-6a57012c58f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1674 microversion: 2.1 time: 0.163461 Jul 07 04:07:27.296047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 453/881] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:27 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:27.301760 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:27.302466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:27.309973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:27.310507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:27.311350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:27.311860 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:27.445320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:27.453702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:27.455279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:27.456525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-79c99e46-1cd8-4fea-8d7a-9b7dad30de6b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.158654 Jul 07 04:07:27.457448 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 429/882] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:27 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:28.303142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:28.303759 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:28.310374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:28.310830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:28.311602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:28.312039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:28.454764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:28.462867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-58757de1-e6e6-402e-b924-e551cefc2734 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1674 microversion: 2.1 time: 0.163506 Jul 07 04:07:28.463476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 454/883] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:28 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:28.475122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:28.475737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:28.482872 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:28.483323 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:28.484085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:28.484548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:28.618391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:28.627873 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:28.630112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:28.633373 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a1787839-4fc4-40cc-b963-93334767ef2e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.161943 Jul 07 04:07:28.633985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 430/884] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:28 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:29.481670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:29.482284 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:29.489531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:29.490076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:29.490848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:29.491323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:29.653041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:29.653669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:29.662618 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:29.663351 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:29.664324 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:29.665206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:29.998749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:30.007056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bfbbf62e-593b-4aae-be49-196eab5297fc tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1674 microversion: 2.1 time: 0.530379 Jul 07 04:07:30.008134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 455/885] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:29 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1674 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:30.065971 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:30.074789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:30.076296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:30.077604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3f9cf9e7-7493-44ae-8678-dd007e2d8484 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.430525 Jul 07 04:07:30.078158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 431/886] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:29 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:31.005869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-7324900d-650e-40bc-b23c-5ca684160017 req-454bf763-792d-4cf5-9f7c-d73f40aea0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a0e9ce-7bb6-48e1-91d6-c339089593b5", "name": "network-vif-deleted", "tag": "fd4c0db4-506e-4b87-a7dc-fb151a54c015"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:31.014880 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7324900d-650e-40bc-b23c-5ca684160017 req-454bf763-792d-4cf5-9f7c-d73f40aea0c1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:31.015550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7324900d-650e-40bc-b23c-5ca684160017 req-454bf763-792d-4cf5-9f7c-d73f40aea0c1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:31.028445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:31.028445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:31.029015 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-7324900d-650e-40bc-b23c-5ca684160017 req-454bf763-792d-4cf5-9f7c-d73f40aea0c1 service nova] Creating event network-vif-deleted:fd4c0db4-506e-4b87-a7dc-fb151a54c015 for instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 on hv-cinder-84684 Jul 07 04:07:31.033610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-7324900d-650e-40bc-b23c-5ca684160017 req-454bf763-792d-4cf5-9f7c-d73f40aea0c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 Jul 07 04:07:31.034251 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 456/887] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:07:31.045924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:31.046698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:31.047498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:31.047943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:31.099052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:31.099911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:31.119557 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:31.120702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:31.122135 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:31.126582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:31.128148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:31.138587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5306377e-2dab-4601-a65c-b84f89a2322b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 200 len: 1322 microversion: 2.1 time: 0.117208 Jul 07 04:07:31.139665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 432/888] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:31 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 1322 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:31.326329 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:31.328804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:31.336456 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:31.338555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:31.339921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aca1c10d-07d5-4de7-8b43-d0a10a00a433 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.248011 Jul 07 04:07:31.340594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 457/889] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:31 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:32.156239 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:32.157563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:32.162715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:32.164951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:32.165843 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:32.167823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:32.167823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:32.183019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 HTTP/1.1 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:07:32.185010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:07:32.186674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '46a0e9ce-7bb6-48e1-91d6-c339089593b5'} Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:07:32.187612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:07:32.189701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:07:32.191045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:07:32.191045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a8da3ccf-b08e-4c78-bd3e-bd2a5c1c6480 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 404 len: 111 microversion: 2.1 time: 0.037524 Jul 07 04:07:32.192100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 433/890] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:32 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:07:32.200022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-476de954-eee9-48b3-8a96-b841e93b26c5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '.version_select at 0x7ff655444820>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:32.203574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:32.208190 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:32.223842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-476de954-eee9-48b3-8a96-b841e93b26c5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724911667" status: 202 len: 0 microversion: 2.1 time: 0.027528 Jul 07 04:07:32.224886 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 458/891] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jul 7 04:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724911667 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 04:07:32.359882 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:32.360537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:32.369114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:32.369854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:32.371510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:32.372127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:32.628968 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:32.639757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:32.641674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:32.643922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-02219e8b-eeb8-4698-a278-5bf4a4ee27f5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.288631 Jul 07 04:07:32.645543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 434/892] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:32 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:33.110558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-08ccd35b-09ed-4b34-a6e6-e1eec6a87166 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: .version_select at 0x7ff65547c700>, body: {"keypair": {"name": "tempest-keypair-59945119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/rmsCaLnc/5+mJ0sYboLOpVniUgi0pPyjLu53dYDIRT9GVmVFZ7SyWEZa3NHi4Gj9wsh8T8MdBFpVkXrourewrLwpNWZol7uX8rDIoM7R1NoTOA1s+uFEO1jZ4WEiDeg=="}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:33.129212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-08ccd35b-09ed-4b34-a6e6-e1eec6a87166 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:33.134034 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-08ccd35b-09ed-4b34-a6e6-e1eec6a87166 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for user 4562cd7ed5c845ce883667028a42fb3d and project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:33.157879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-08ccd35b-09ed-4b34-a6e6-e1eec6a87166 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053472 Jul 07 04:07:33.158523 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 459/893] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:07:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:33.663432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:33.664122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:33.674142 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:33.676723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:33.679723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:33.680169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:33.944650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:33.961950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:33.966491 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:33.967822 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d1af1ef2-0e2e-425f-b4dc-5ff56dfff9e8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.308426 Jul 07 04:07:33.971238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 435/894] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:33 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:34.566607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-df0b872a-cee5-4efd-80db-c84bac973276 req-74b46a06-98ef-4e4a-b13e-84ccc22ff22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "name": "network-vif-plugged", "status": "completed", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:34.588251 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-df0b872a-cee5-4efd-80db-c84bac973276 req-74b46a06-98ef-4e4a-b13e-84ccc22ff22a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:34.589370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-df0b872a-cee5-4efd-80db-c84bac973276 req-74b46a06-98ef-4e4a-b13e-84ccc22ff22a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:34.612104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-df0b872a-cee5-4efd-80db-c84bac973276 req-74b46a06-98ef-4e4a-b13e-84ccc22ff22a service nova] Creating event network-vif-plugged:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:07:34.620005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-df0b872a-cee5-4efd-80db-c84bac973276 req-74b46a06-98ef-4e4a-b13e-84ccc22ff22a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061327 Jul 07 04:07:34.622207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 460/895] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:34.897504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-614544675", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84b0448c-9593-4f3f-a8de-01ac7957c004"}], "security_groups": [{"name": "tempest-securitygroup--50035949"}], "key_name": "tempest-keypair-59945119", "user_data": "}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:34.993533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:34.994385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:35.002428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:35.003032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:35.004644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:35.005194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:35.145934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] validate_networks() for [('84b0448c-9593-4f3f-a8de-01ac7957c004', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:07:35.340035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:35.349774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:35.351283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:35.352784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ccfe3911-db90-4497-b2bd-b190ec896491 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.363951 Jul 07 04:07:35.354067 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 461/896] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:34 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:07:35.854946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:07:35.855734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:07:35.856356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:07:35.856775 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:07:35.857695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:07:35.863057 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:35.872239 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:35.872722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:35.873515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:35.873953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:35.899953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:35.905267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Getting quotas for user 4562cd7ed5c845ce883667028a42fb3d and project fc78ef06a31540ebb996ccb4a6a160f5. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:35.918266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:07:35.920598 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:07:35.973073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4af12b19-dae7-4185-a6de-5d1b9204126a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.080243 Jul 07 04:07:35.974579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 436/897] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:07:34 2022] POST /compute/v2.1/servers => generated 400 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:07:35.985784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e9bfd09f-67c9-4f3b-9384-1dfbf019e474 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:35.987980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e9bfd09f-67c9-4f3b-9384-1dfbf019e474 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:36.111426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e9bfd09f-67c9-4f3b-9384-1dfbf019e474 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:36.122162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e9bfd09f-67c9-4f3b-9384-1dfbf019e474 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1235 microversion: 2.1 time: 0.140659 Jul 07 04:07:36.122999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 462/898] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:35 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1235 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:36.372794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:36.373466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:36.390403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:36.390853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:36.393791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:36.394277 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:36.697171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:36.708921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:36.711682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:36.714262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-794fabbf-80ae-4a62-ab84-0db57b9ba581 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1407 microversion: 2.20 time: 0.347004 Jul 07 04:07:36.714851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 437/899] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:36 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:36.919596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3c459773-7fa6-4862-978f-ad8dd0b3d44f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: .version_select at 0x7ff655450d30>, body: {"keypair": {"name": "tempest-keypair-59331380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhrxRNiBqN9IsjHrhoopp9Gd2HXC49TwZRngo+EFjFJkZ3KmF3XRWTSctAyjc3uVdgCrAX7uaGXoGSrurG5oFFU0ZLxuizhrADxJiKW/5ZXaiZoMOSX+3yZiWM7O2c1Yg=="}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:36.935803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-3c459773-7fa6-4862-978f-ad8dd0b3d44f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:36.939833 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-3c459773-7fa6-4862-978f-ad8dd0b3d44f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:36.962470 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3c459773-7fa6-4862-978f-ad8dd0b3d44f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.165650 Jul 07 04:07:36.963121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 463/900] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:07:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:37.141790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:37.142434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:37.153281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:37.153785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:37.159082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:37.160363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:37.165596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:37.240648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:37.248737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2f61a8db-90ad-4455-9721-205755648389 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1239 microversion: 2.1 time: 0.112677 Jul 07 04:07:37.249348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 438/901] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:37 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:37.732728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:37.733953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:37.741986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:37.742738 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:37.743799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:37.744483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:37.999556 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:38.012617 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:38.014186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:38.015372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-513a5247-0175-456c-81bd-faaeda21c775 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1599 microversion: 2.20 time: 0.286998 Jul 07 04:07:38.020926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 464/902] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:07:37 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1599 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:07:38.034456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:38.034961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:38.044842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:38.045403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:38.046293 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:38.047325 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:38.175866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ff6a8416-347d-433e-93bd-dd5486f2c2bd tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145361 Jul 07 04:07:38.176686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 439/903] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Jul 7 04:07:38 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 04:07:38.269213 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:38.270340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:38.279360 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:38.280210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:38.281879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:38.282735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:38.386848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:38.395678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b517afc0-cd4e-459d-a831-a49e8fa0f2d4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1293 microversion: 2.1 time: 0.132370 Jul 07 04:07:38.396822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 465/904] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:38 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:39.276896 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1005244828", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb43ae82-16c6-4173-a04e-f756cd39db29"}], "security_groups": [{"name": "tempest-securitygroup--1865654417"}], "key_name": "tempest-keypair-59331380", "user_data": "}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:39.414668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:39.415379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:39.427844 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:39.428580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:39.429531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:39.430735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:39.778596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] validate_networks() for [('eb43ae82-16c6-4173-a04e-f756cd39db29', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:07:40.281794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:40.285678 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:40.292505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aa4d1b60-89a6-46bb-ac1c-768fa0f93294 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.883041 Jul 07 04:07:40.302908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 466/905] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:39 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:40.308290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ecf68fe1-bf80-4f18-b454-7f4b37905636 req-3b6b1b2a-5e35-4b05-99cc-a29ef4d5e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d106975f-a8a3-4bbe-95a5-ccfa1015eea6", "tag": "22d36d0a-08e1-476a-9fd1-66cf1abaed74"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:40.318060 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ecf68fe1-bf80-4f18-b454-7f4b37905636 req-3b6b1b2a-5e35-4b05-99cc-a29ef4d5e37b service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:40.318497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ecf68fe1-bf80-4f18-b454-7f4b37905636 req-3b6b1b2a-5e35-4b05-99cc-a29ef4d5e37b service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:40.339097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ecf68fe1-bf80-4f18-b454-7f4b37905636 req-3b6b1b2a-5e35-4b05-99cc-a29ef4d5e37b service nova] Creating event network-changed:22d36d0a-08e1-476a-9fd1-66cf1abaed74 for instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 on hv-cinder-84684 Jul 07 04:07:40.352181 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-ecf68fe1-bf80-4f18-b454-7f4b37905636 req-3b6b1b2a-5e35-4b05-99cc-a29ef4d5e37b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047659 Jul 07 04:07:40.353242 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 467/906] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:40.825067 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:07:40.825685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:07:40.826283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:07:40.826787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:07:40.827295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:07:40.841997 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-79fcb738-2bd3-42bc-9401-95a68959a1b2 req-1c699845-2f28-45d8-9920-74b6ba7bcef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:40.845433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:40.846438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:40.847459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:40.847995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:40.852596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-79fcb738-2bd3-42bc-9401-95a68959a1b2 req-1c699845-2f28-45d8-9920-74b6ba7bcef3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:40.853245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-79fcb738-2bd3-42bc-9401-95a68959a1b2 req-1c699845-2f28-45d8-9920-74b6ba7bcef3 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:40.866606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:07:40.870220 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-79fcb738-2bd3-42bc-9401-95a68959a1b2 req-1c699845-2f28-45d8-9920-74b6ba7bcef3 service nova] Creating event network-changed:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:07:40.871695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:07:40.882269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-79fcb738-2bd3-42bc-9401-95a68959a1b2 req-1c699845-2f28-45d8-9920-74b6ba7bcef3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044606 Jul 07 04:07:40.883458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 468/907] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:40.884742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:07:40.887531 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:07:40.940163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ae1896f4-928b-4b31-b27e-a7c7c3a94f3f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.676824 Jul 07 04:07:40.940854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 440/908] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:07:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:07:40.952426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-17269671-f8b1-49dc-bdfb-152b30c11c11 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:40.953375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-17269671-f8b1-49dc-bdfb-152b30c11c11 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:41.041819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-17269671-f8b1-49dc-bdfb-152b30c11c11 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:41.053156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-17269671-f8b1-49dc-bdfb-152b30c11c11 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1240 microversion: 2.1 time: 0.105995 Jul 07 04:07:41.054017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 469/909] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:40 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:41.310751 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:41.311758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:41.322679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:41.324617 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:41.325809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:41.326881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:41.624989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:41.632463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f966da5b-184f-4367-b02c-7cc1804a5dc4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.325864 Jul 07 04:07:41.633031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 441/910] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:41 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:42.071089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:42.071716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:42.079710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:42.080158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:42.080952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:42.081390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:42.143791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:42.151066 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d8fd9711-dabd-4c16-9bc2-51dd6b49a7ba tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1244 microversion: 2.1 time: 0.084020 Jul 07 04:07:42.151627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 470/911] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:42 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:42.650117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:42.650733 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:42.657827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:42.658279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:42.659047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:42.659490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:42.787749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:42.795643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7f437d2a-f00b-4c84-b5ac-57173623d7d1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.149395 Jul 07 04:07:42.796208 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 442/912] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:42 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:43.168097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:43.168746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:43.175189 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:43.175627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:43.176436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:43.176867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:43.238979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:43.246998 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3fa7ac73-12f1-4ffc-84a6-b24f5cca413f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1244 microversion: 2.1 time: 0.082684 Jul 07 04:07:43.247485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 471/913] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:43 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:43.813003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:43.813649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:43.819647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:43.820101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:43.820899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:43.821345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:43.949109 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:43.956425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7eb2efb2-c685-4c7b-b793-feede62914f5 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.147810 Jul 07 04:07:43.956974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 443/914] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:43 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:44.264100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:44.264725 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:44.274292 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:44.275622 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:44.276685 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:44.277541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:44.382539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:44.390218 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d49a058f-2ee5-4f34-b659-43a2608cda81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1236 microversion: 2.1 time: 0.130621 Jul 07 04:07:44.391396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 472/915] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:44 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1236 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:44.973834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:44.974376 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:44.982577 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:44.983120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:44.983775 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:44.984208 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:45.125574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:45.133031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-44a8d547-0953-4100-a627-f73bc3566276 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.163680 Jul 07 04:07:45.133596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 444/916] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:44 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:45.408125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:45.408863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:45.415375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:45.415833 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:45.416635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:45.417075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:45.484831 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:45.492896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-961e524d-69d1-4007-a7e8-5e036d79e617 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1298 microversion: 2.1 time: 0.088706 Jul 07 04:07:45.493469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 473/917] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:45 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:46.150242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:46.150960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:46.161077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:46.161314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:46.162694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:46.163282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:46.341890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:46.350271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b33f7c47-866e-4c10-9650-a39427f43e0a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.203747 Jul 07 04:07:46.351051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 445/918] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:46 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:46.412823 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-0c54e182-3836-445b-80cf-22bc10fc6d9e req-749e832d-0b8e-4ca1-95d7-267f96f60523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52aceba7-9cb8-4018-b6d9-564135ba117a", "tag": "b6e75047-28ef-4468-8652-151481ddb11a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:46.427522 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0c54e182-3836-445b-80cf-22bc10fc6d9e req-749e832d-0b8e-4ca1-95d7-267f96f60523 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:46.428115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0c54e182-3836-445b-80cf-22bc10fc6d9e req-749e832d-0b8e-4ca1-95d7-267f96f60523 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:46.467740 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-0c54e182-3836-445b-80cf-22bc10fc6d9e req-749e832d-0b8e-4ca1-95d7-267f96f60523 service nova] Creating event network-changed:b6e75047-28ef-4468-8652-151481ddb11a for instance 52aceba7-9cb8-4018-b6d9-564135ba117a on hv-cinder-84684 Jul 07 04:07:46.477727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-0c54e182-3836-445b-80cf-22bc10fc6d9e req-749e832d-0b8e-4ca1-95d7-267f96f60523 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074145 Jul 07 04:07:46.478377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 474/919] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:46.515675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:46.516665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:46.523587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:46.524287 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:46.525353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:46.525942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:46.675808 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:46.684530 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-77a20cf2-ddbd-4926-a002-ae96953ffb3d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.178004 Jul 07 04:07:46.685119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 446/920] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:46 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:47.367750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:47.368491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:47.375331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:47.375782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:47.376565 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:47.377001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:47.507195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:47.514501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-70c3c386-f911-47cf-b414-236e7794b2e2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.151044 Jul 07 04:07:47.515040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 475/921] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:47 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:47.701364 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:47.701978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:47.708523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:47.708972 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:47.709722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:47.710150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:47.837542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:47.845676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ab91caaa-02a2-4ff7-96de-dc722ce1ff84 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.148300 Jul 07 04:07:47.846243 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 447/922] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:47 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:48.344571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-09eefafd-5914-439b-b99f-4eab247fb244 req-ba459f1e-39d4-4d36-babd-a1bdd1939acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d106975f-a8a3-4bbe-95a5-ccfa1015eea6", "name": "network-vif-plugged", "status": "completed", "tag": "22d36d0a-08e1-476a-9fd1-66cf1abaed74"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:48.352906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-09eefafd-5914-439b-b99f-4eab247fb244 req-ba459f1e-39d4-4d36-babd-a1bdd1939acf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:48.353347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-09eefafd-5914-439b-b99f-4eab247fb244 req-ba459f1e-39d4-4d36-babd-a1bdd1939acf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:48.365726 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-09eefafd-5914-439b-b99f-4eab247fb244 req-ba459f1e-39d4-4d36-babd-a1bdd1939acf service nova] Creating event network-vif-plugged:22d36d0a-08e1-476a-9fd1-66cf1abaed74 for instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 on hv-cinder-84684 Jul 07 04:07:48.370458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-09eefafd-5914-439b-b99f-4eab247fb244 req-ba459f1e-39d4-4d36-babd-a1bdd1939acf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029639 Jul 07 04:07:48.371052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 476/923] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:48.531438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:48.532050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:48.538002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:48.538446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:48.539200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:48.539632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:48.666473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:48.674228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7ab26855-b07c-4710-9900-ce422280716a tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.147320 Jul 07 04:07:48.674790 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 448/924] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:48 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:48.864472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:48.865261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:48.872068 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:48.872545 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:48.873297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:48.873734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:49.006864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:49.014751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bc32c959-02af-4c67-831a-2bbeb2b210c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.154937 Jul 07 04:07:49.015324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 477/925] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:48 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:49.691216 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:49.691853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:49.698464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:49.698913 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:49.700256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:49.700714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:49.829383 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:49.836691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4df4ef8a-1b5e-4b58-bd07-c393cae2197b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.149316 Jul 07 04:07:49.837250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 449/926] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:49 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:50.031033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:50.031590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:50.037993 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:50.038443 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:50.039196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:50.039630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:50.170431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:50.177890 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ba5006c-97b0-42af-8f78-8e67a8e79d89 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.150882 Jul 07 04:07:50.178455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 478/927] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:50 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:50.853722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:50.854330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:50.858794 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=4 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:50.868290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:50.868743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:50.869520 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:50.869950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:50.886623 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=12 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:50.999741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:51.007115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c9fd3a3a-5b3b-4d74-b019-31ee636a4992 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.157141 Jul 07 04:07:51.007685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 450/928] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:50 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:51.195396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:51.196109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:51.198687 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=12 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:51.204464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:51.204858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:51.205619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:51.206053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:51.336669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:51.344853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-698018ba-44a6-4359-87b1-9f2529eff69f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.153554 Jul 07 04:07:51.345649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 479/929] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:51 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:52.023146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:52.023685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:52.030907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:52.031355 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:52.032121 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:52.032624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:52.178327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:52.186354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8040c559-231b-45d5-8545-af2e5326e848 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1359 microversion: 2.1 time: 0.167145 Jul 07 04:07:52.186930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 451/930] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:52 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:52.363506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:52.364898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:52.371573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:52.372016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:52.373436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:52.373868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:52.448511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-016d2ec1-e653-4ad1-981e-e23931b9be42 req-ffd91236-581d-4630-ba6f-ee31f9916762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aceba7-9cb8-4018-b6d9-564135ba117a", "name": "network-vif-plugged", "status": "completed", "tag": "b6e75047-28ef-4468-8652-151481ddb11a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:52.457469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-016d2ec1-e653-4ad1-981e-e23931b9be42 req-ffd91236-581d-4630-ba6f-ee31f9916762 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:52.458141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-016d2ec1-e653-4ad1-981e-e23931b9be42 req-ffd91236-581d-4630-ba6f-ee31f9916762 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:52.469885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-016d2ec1-e653-4ad1-981e-e23931b9be42 req-ffd91236-581d-4630-ba6f-ee31f9916762 service nova] Creating event network-vif-plugged:b6e75047-28ef-4468-8652-151481ddb11a for instance 52aceba7-9cb8-4018-b6d9-564135ba117a on hv-cinder-84684 Jul 07 04:07:52.475228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-016d2ec1-e653-4ad1-981e-e23931b9be42 req-ffd91236-581d-4630-ba6f-ee31f9916762 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 Jul 07 04:07:52.476071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 452/931] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:52.518625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:52.526016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-be117c4e-be72-47cf-976a-3108fb6a588a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.166323 Jul 07 04:07:52.526575 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 480/932] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:52 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:53.204044 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:53.204821 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:53.210927 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.211370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.212184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.212721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.348619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:53.355944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-aa70c546-2c48-4187-9738-02583a3be554 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1546 microversion: 2.1 time: 0.156791 Jul 07 04:07:53.356547 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 453/933] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:53 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:53.373375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:53.373914 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:53.380480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.380924 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.381676 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.382105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.542989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:53.543714 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:53.549902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.550348 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.551113 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:53.551548 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:53.634866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bbac0a17-e681-4bd1-adea-3715e61393df tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265340 Jul 07 04:07:53.635533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 481/934] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:07:53 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-interface => generated 285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:53.702773 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:53.709989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0d3e4e3e-2cfb-43e1-8af5-69e6007548f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.170944 Jul 07 04:07:53.710556 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 454/935] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:53 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:07:54.553795 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-3c910f83-4928-44c8-9bbf-7ac0bf672335 req-79e6c08a-872f-48fd-8752-298ad0d37bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d106975f-a8a3-4bbe-95a5-ccfa1015eea6", "tag": "22d36d0a-08e1-476a-9fd1-66cf1abaed74"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:54.561773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3c910f83-4928-44c8-9bbf-7ac0bf672335 req-79e6c08a-872f-48fd-8752-298ad0d37bc5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:54.562214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3c910f83-4928-44c8-9bbf-7ac0bf672335 req-79e6c08a-872f-48fd-8752-298ad0d37bc5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:54.572729 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-3c910f83-4928-44c8-9bbf-7ac0bf672335 req-79e6c08a-872f-48fd-8752-298ad0d37bc5 service nova] Creating event network-changed:22d36d0a-08e1-476a-9fd1-66cf1abaed74 for instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 on hv-cinder-84684 Jul 07 04:07:54.578408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-3c910f83-4928-44c8-9bbf-7ac0bf672335 req-79e6c08a-872f-48fd-8752-298ad0d37bc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028720 Jul 07 04:07:54.579001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 482/936] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:54.727115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:54.727942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:54.734742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:54.735320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:54.736190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:54.736771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:54.868640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:54.876679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bea07fa5-193e-4bf2-a795-aa759387d438 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1366 microversion: 2.1 time: 0.153363 Jul 07 04:07:54.877335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 455/937] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:54 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:55.894204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:55.894905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:55.901611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:55.902002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:55.902766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:55.903205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:56.038210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:07:56.045558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5cedf63f-df4c-4186-bcca-cab142449d1a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1556 microversion: 2.1 time: 0.155483 Jul 07 04:07:56.046115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 483/938] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:07:55 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:07:56.062420 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:07:56.062945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:07:56.069330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:56.069779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:56.070540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:56.070976 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:56.088044 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=100 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:56.147920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-62a71546-632f-4abe-bb06-9f6e41d79cd9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089777 Jul 07 04:07:56.148570 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 456/939] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:07:56 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:07:57.333277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-b034c37d-6681-4cf0-80b0-c416e2d59f07 req-642cf442-b411-4542-99c3-4e19f32632c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52aceba7-9cb8-4018-b6d9-564135ba117a", "tag": "b6e75047-28ef-4468-8652-151481ddb11a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:07:57.343149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-b034c37d-6681-4cf0-80b0-c416e2d59f07 req-642cf442-b411-4542-99c3-4e19f32632c5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:07:57.343594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-b034c37d-6681-4cf0-80b0-c416e2d59f07 req-642cf442-b411-4542-99c3-4e19f32632c5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:07:57.354449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-b034c37d-6681-4cf0-80b0-c416e2d59f07 req-642cf442-b411-4542-99c3-4e19f32632c5 service nova] Creating event network-changed:b6e75047-28ef-4468-8652-151481ddb11a for instance 52aceba7-9cb8-4018-b6d9-564135ba117a on hv-cinder-84684 Jul 07 04:07:57.360358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-b034c37d-6681-4cf0-80b0-c416e2d59f07 req-642cf442-b411-4542-99c3-4e19f32632c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030755 Jul 07 04:07:57.361014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 484/940] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:08:18.994274 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:18.998491 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:18.998986 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:19.006759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:19.007203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:19.007950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:19.008412 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:19.032240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:08:19.104843 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d1fc6490-9ba2-406f-9a22-f68acdb6ef54 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 204 len: 0 microversion: 2.1 time: 0.111881 Jul 07 04:08:19.105706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 457/941] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:08:18 2022] DELETE /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:08:19.112773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:19.113542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=76 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:19.118197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:19.118905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:19.127045 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:19.127506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:19.128302 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:19.128741 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:19.315269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:19.322764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a3a2911f-5f2b-4006-b3a7-0a1cd21cf09b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1578 microversion: 2.1 time: 0.211826 Jul 07 04:08:19.323335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 485/942] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:19 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:20.342360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:20.343697 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:20.350489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:20.350937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:20.351690 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:20.352124 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:20.534725 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:20.542209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8490e0b0-80b0-4ef7-a157-5165e6513d8f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1578 microversion: 2.1 time: 0.204090 Jul 07 04:08:20.542779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 458/943] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:20 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:21.558939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:21.559553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:21.566753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:21.567215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:21.567989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:21.568677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:21.857098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:21.865087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ef7dc43d-5749-4693-b971-819bb64479b2 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1511 microversion: 2.1 time: 0.309811 Jul 07 04:08:21.866213 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 486/944] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:21 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:22.132495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-58df3063-7f79-4c29-9e76-50bcb26f4074 req-6de2e96f-8cd7-4bad-80b4-b07a5684e641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc26698e-e0d0-4fd6-8cc1-607d89ebb414", "name": "network-vif-deleted", "tag": "a980d17b-ea5d-4119-a9c8-03335bf8492a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:22.137368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:22.138180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:22.146036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-58df3063-7f79-4c29-9e76-50bcb26f4074 req-6de2e96f-8cd7-4bad-80b4-b07a5684e641 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.146494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-58df3063-7f79-4c29-9e76-50bcb26f4074 req-6de2e96f-8cd7-4bad-80b4-b07a5684e641 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.148043 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.159368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.160481 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.160654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-58df3063-7f79-4c29-9e76-50bcb26f4074 req-6de2e96f-8cd7-4bad-80b4-b07a5684e641 service nova] Creating event network-vif-deleted:a980d17b-ea5d-4119-a9c8-03335bf8492a for instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 on hv-cinder-84684 Jul 07 04:08:22.161083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.167997 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-58df3063-7f79-4c29-9e76-50bcb26f4074 req-6de2e96f-8cd7-4bad-80b4-b07a5684e641 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040298 Jul 07 04:08:22.168939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 459/945] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:08:22.177728 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-d444c5bb-fe8c-4c1d-bddd-0d18c077baa0 req-df830d61-1023-4600-8a40-43f71921f8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:22.189484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d444c5bb-fe8c-4c1d-bddd-0d18c077baa0 req-df830d61-1023-4600-8a40-43f71921f8dd service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.190279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d444c5bb-fe8c-4c1d-bddd-0d18c077baa0 req-df830d61-1023-4600-8a40-43f71921f8dd service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.215652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:08:22.238428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-d444c5bb-fe8c-4c1d-bddd-0d18c077baa0 req-df830d61-1023-4600-8a40-43f71921f8dd service nova] Creating event network-changed:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:08:22.243828 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-d444c5bb-fe8c-4c1d-bddd-0d18c077baa0 req-df830d61-1023-4600-8a40-43f71921f8dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069957 Jul 07 04:08:22.244753 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 460/946] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:08:22.366918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c524f25-0fa8-4c0e-870f-d9e967947802 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "DELETE /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 204 len: 0 microversion: 2.1 time: 0.232822 Jul 07 04:08:22.367920 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 487/947] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:08:22 2022] DELETE /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:08:22.377042 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:22.377749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:22.385836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.386286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.387058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.387493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.559655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:22.567144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b8bc622b-b3fc-4a01-9ad4-95e03ad4156d tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.194805 Jul 07 04:08:22.567715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 461/948] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:22 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:22.884027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:22.884677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:22.891883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.892303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.893075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:22.893690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:22.963197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:22.973950 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ee830b79-ede3-4221-b875-5a55bd0033e1 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1226 microversion: 2.1 time: 0.092412 Jul 07 04:08:22.974852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 488/949] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:22 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:23.585652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:23.587040 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:23.594639 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:23.595210 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:23.596064 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:23.596601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:23.732818 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:23.740365 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-286fb7ce-bf90-45c7-b132-108978ca3c28 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1568 microversion: 2.1 time: 0.158693 Jul 07 04:08:23.740930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 462/950] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:23 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:23.990940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:23.991477 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:23.998036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:23.998495 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:23.999323 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:23.999874 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:24.032639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:24.033093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:24.033544 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lazy-loading 'fault' on Instance uuid dc26698e-e0d0-4fd6-8cc1-607d89ebb414 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:08:24.074742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:24.082805 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-44a0017c-9aba-47f6-903b-43c3db305095 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 200 len: 1231 microversion: 2.1 time: 0.095840 Jul 07 04:08:24.083367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 489/951] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:23 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:24.758240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:24.759688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:24.766949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:24.767617 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:24.768582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:24.769030 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:24.960157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:24.967640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-203272ba-29d6-4252-9244-045d067645e9 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1449 microversion: 2.1 time: 0.213325 Jul 07 04:08:24.968377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 463/952] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:24 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1449 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:25.099460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:25.100069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:25.106691 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.107142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.107939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.108418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.118670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-310cb0ab-9974-4056-953d-31cec61006ff req-5e0729d2-61b9-46a8-b6c2-ad49a74f0458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153a1cb5-acd7-4aad-b5e4-c7930015786f", "name": "network-vif-deleted", "tag": "b1eb32a2-0960-4ab1-9887-80879a4c905f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:25.125091 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] HTTP exception thrown: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Request method failure captured: Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 HTTP/1.1 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlszwDCyKn8fBDt4LiNs3hShrHJEpoTgOANIFKaiZPSeckjS8tpiN26khkm-eyUm9OHVz2LzWroYVUDZIkn9SGCIJBNKGwQqhPXVs6D5_vmdnSVN13BCJzYj4jPb5QFhsZ97tN3coYBO4IqE1xhVi47_qdCaKAjXr4TwA3SMZ2N_kKA Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:08:25.127065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-TestVolumeBootPattern-64413915 Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f90b6a7eecf247ac9baa9351ae51096d Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:08:25.128596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'dc26698e-e0d0-4fd6-8cc1-607d89ebb414'} Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:08:25.130024 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:08:25.131414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:08:25.132742 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Returning 404 to user: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:08:25.132841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-310cb0ab-9974-4056-953d-31cec61006ff req-5e0729d2-61b9-46a8-b6c2-ad49a74f0458 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.132841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-310cb0ab-9974-4056-953d-31cec61006ff req-5e0729d2-61b9-46a8-b6c2-ad49a74f0458 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.133028 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fc9d3681-6ca5-44af-a797-138f789de29d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 404 len: 111 microversion: 2.1 time: 0.033320 Jul 07 04:08:25.133028 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 490/953] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:25 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:08:25.147665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-310cb0ab-9974-4056-953d-31cec61006ff req-5e0729d2-61b9-46a8-b6c2-ad49a74f0458 service nova] Creating event network-vif-deleted:b1eb32a2-0960-4ab1-9887-80879a4c905f for instance 153a1cb5-acd7-4aad-b5e4-c7930015786f on hv-cinder-84684 Jul 07 04:08:25.153901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-310cb0ab-9974-4056-953d-31cec61006ff req-5e0729d2-61b9-46a8-b6c2-ad49a74f0458 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039304 Jul 07 04:08:25.154516 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 464/954] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:08:25.227101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-365063188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275067466", "security_groups": [{"name": "tempest-secgroup-smoke-152699616"}], "block_device_mapping_v2": [{"uuid": "93b37509-c0d3-4718-ba7d-a682652ed451", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e6f7a7e-402a-4bce-9487-7febb928a485"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:25.341377 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] validate_networks() for [('7e6f7a7e-402a-4bce-9487-7febb928a485', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:08:25.762964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:08:25.763381 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:08:25.763898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:08:25.764321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:08:25.764733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:08:25.773587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.774031 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.774808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.775243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.791380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:08:25.795177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for user f90b6a7eecf247ac9baa9351ae51096d and project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:08:25.854796 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:08:25.856894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93b37509-c0d3-4718-ba7d-a682652ed451',volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:08:25.986989 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:25.988522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:25.996208 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:25.996844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:25.997574 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:26.000116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-00a911e9-20cc-4f3f-bbf3-ff381c065471 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776572 Jul 07 04:08:26.001325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 491/955] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:08:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:08:26.006307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:26.016464 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-842355eb-3f6e-44f7-a5ce-e0ab4a1e63d9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:26.020714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-842355eb-3f6e-44f7-a5ce-e0ab4a1e63d9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:26.057138 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:26.058326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:26.058949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lazy-loading 'fault' on Instance uuid 153a1cb5-acd7-4aad-b5e4-c7930015786f {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:08:26.094263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-842355eb-3f6e-44f7-a5ce-e0ab4a1e63d9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:26.101176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-842355eb-3f6e-44f7-a5ce-e0ab4a1e63d9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1094 microversion: 2.1 time: 0.093471 Jul 07 04:08:26.112467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 492/956] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:26 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:26.131784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34fe999226aa4ebaacc541e0854825bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b8ba212b774067992a28085296c091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:26.138647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7af967aa-15e9-4996-b207-86e83b05670f tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 200 len: 1178 microversion: 2.1 time: 0.155931 Jul 07 04:08:26.142194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 465/957] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:25 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 1178 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:27.118559 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:27.119147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:27.126859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:27.127505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:27.128299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:27.128735 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:27.157925 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:27.158636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] [instance: 153a1cb5-acd7-4aad-b5e4-c7930015786f] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:27.165791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:27.166907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:27.167761 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:27.168315 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:27.183987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] HTTP exception thrown: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Request method failure captured: Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f HTTP/1.1 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlqMw9XWftv1q-ihhcPTTQO-jY8OMcwLVn-6j-mQ7rYDqnju1U0wiG744igYr0XpCdUpZR2PWjjHcuOA7_Qn7hOSfOA0x-smQCo8Tij69nKuQIrh5D7M7qS2IfMPOsJHQqAj9TrFi2DuT7w5EquWFHwoZNLs5N0sEt6osSb0Xl2g-5M Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: d3b8ba212b774067992a28085296c091 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-TestShelveInstance-1862255794 Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:08:27.185961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3b8ba212b774067992a28085296c091"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3b8ba212b774067992a28085296c091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3b8ba212b774067992a28085296c091"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3b8ba212b774067992a28085296c091"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-TestShelveInstance-1862255794 Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: d3b8ba212b774067992a28085296c091 Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-TestShelveInstance-1862255794 Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-TestShelveInstance-1862255794-project Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 34fe999226aa4ebaacc541e0854825bf Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-TestShelveInstance-1862255794-project Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. Jul 07 04:08:27.187636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '153a1cb5-acd7-4aad-b5e4-c7930015786f'} Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:08:27.188587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. Jul 07 04:08:27.190093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:08:27.191847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:27.192812 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Returning 404 to user: Instance 153a1cb5-acd7-4aad-b5e4-c7930015786f could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:08:27.193987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ac1afcb2-b63d-43d3-ad58-77023146be9b tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f" status: 404 len: 111 microversion: 2.1 time: 0.040708 Jul 07 04:08:27.194722 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 466/958] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:27 2022] GET /compute/v2.1/servers/153a1cb5-acd7-4aad-b5e4-c7930015786f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:08:27.201098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-83893a25-c837-4a5b-9d6f-383c54d39e1b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1136 microversion: 2.1 time: 0.086348 Jul 07 04:08:27.201965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 493/959] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:27 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:27.362999 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8abf3bdf-6a78-40e8-962c-62c28130c3c5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] Calling method '.version_select at 0x7ff65554cca0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:27.383778 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8abf3bdf-6a78-40e8-962c-62c28130c3c5 tempest-TestShelveInstance-1862255794 tempest-TestShelveInstance-1862255794-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-834653791" status: 202 len: 0 microversion: 2.1 time: 0.024558 Jul 07 04:08:27.384379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 467/960] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jul 7 04:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-834653791 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:08:28.218767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:28.219383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:28.227124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:28.227124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:28.227749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:28.228423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:28.462111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:28.484566 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ef38b0b-7826-42ff-844b-3852c0f41fd6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1277 microversion: 2.1 time: 0.269065 Jul 07 04:08:28.489379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 494/961] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:28 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:29.161173 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-9a8a8dcf-bc48-4bb0-b970-6c884c8ae9db req-a41106ff-31c6-4693-9047-5449bc07c2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9966850f-458c-4317-ab66-5b231051af76", "tag": "a8d6e540-db2d-4268-b805-0a7b254ab005"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:29.180723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-9a8a8dcf-bc48-4bb0-b970-6c884c8ae9db req-a41106ff-31c6-4693-9047-5449bc07c2cd service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:29.181169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-9a8a8dcf-bc48-4bb0-b970-6c884c8ae9db req-a41106ff-31c6-4693-9047-5449bc07c2cd service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:29.193739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-9a8a8dcf-bc48-4bb0-b970-6c884c8ae9db req-a41106ff-31c6-4693-9047-5449bc07c2cd service nova] Creating event network-changed:a8d6e540-db2d-4268-b805-0a7b254ab005 for instance 9966850f-458c-4317-ab66-5b231051af76 on hv-cinder-84684 Jul 07 04:08:29.200095 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-9a8a8dcf-bc48-4bb0-b970-6c884c8ae9db req-a41106ff-31c6-4693-9047-5449bc07c2cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063459 Jul 07 04:08:29.200990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 468/962] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:08:29.505549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:29.506754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:29.513247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:29.513765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:29.514952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:29.515475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:29.739232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:29.747540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-196a8eee-c5fc-4867-81db-7bb1447af308 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.246264 Jul 07 04:08:29.748116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 495/963] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:29 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:30.767040 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:30.769305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:30.783017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:30.783551 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:30.784369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:30.784839 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:30.924471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:30.933655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-88f94ac7-118c-475b-a0f8-91fe772c30de tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.172094 Jul 07 04:08:30.934979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 469/964] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:30 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:31.954578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:31.955192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:31.961790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:31.962249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:31.963116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:31.963435 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:32.257982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:32.266160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6866e705-7ac7-4cc8-bc32-b57c4763e3e5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.314975 Jul 07 04:08:32.266976 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 496/965] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:31 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:33.284090 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:33.285406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:33.292838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:33.293335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:33.294073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:33.294512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:33.511739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:33.520219 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ae59da22-95ea-47a5-9bba-e2948b6b3045 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.241248 Jul 07 04:08:33.520801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 470/966] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:33 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:34.538356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:34.539005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:34.548051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:34.548847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:34.549656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:34.550097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:34.708618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:34.717210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e3e09a15-d615-4880-b215-8bc661f3e92d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.183719 Jul 07 04:08:34.717791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 497/967] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:34 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:08:35.735857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:35.736559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:35.743554 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:35.744007 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:35.744832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:35.745457 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:35.902844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:35.910963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-be57d899-9239-4588-8f1b-a777b341c409 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.179609 Jul 07 04:08:35.911914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 471/968] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:35 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:36.927122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:36.927724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:36.930134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:36.930813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=8 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:36.937776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:36.938234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:36.938990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:36.939418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:37.068929 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:37.076254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ba8cd716-d780-471a-8ca9-7ab72ebdb74d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.153115 Jul 07 04:08:37.076825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 498/969] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:36 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:38.094271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:38.094887 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:38.101698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:38.102144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:38.102906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:38.103340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:38.235278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:38.242696 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8126766d-0f6d-4077-a852-0bc222d4b31d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.153000 Jul 07 04:08:38.243256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 472/970] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:38 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:08:39.259829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:39.260476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:39.267100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:39.267542 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:39.268295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:39.268731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:39.397423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:39.404701 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1c452752-57f9-43f5-b815-0ed398a07606 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.148633 Jul 07 04:08:39.405261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 499/971] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:39 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:40.421006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:40.422195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:40.428789 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:40.429238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:40.429995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:40.430427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:40.564566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:40.571994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3d27d50a-c198-4eb3-b77c-9c421e32e83f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.154783 Jul 07 04:08:40.572673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 473/972] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:40 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:41.588932 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:41.589549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:41.596494 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:41.596940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:41.597692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:41.598121 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:41.730599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:41.738788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1c773337-6dd0-4994-9fec-ff2a1ded1dc9 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.153692 Jul 07 04:08:41.739357 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 500/973] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:41 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:42.756296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:42.756833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:42.763278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:42.763724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:42.764517 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:42.765487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:42.897043 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:42.904540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3d2e57f0-bab4-4d2c-a2f3-042e47f4485f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.152207 Jul 07 04:08:42.905354 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 474/974] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:42 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:43.006375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-56867f56-71b3-4de7-ab26-4ef2a45e9dc8 req-ce3b5877-4cec-4584-b162-599d7d006a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9966850f-458c-4317-ab66-5b231051af76", "name": "network-vif-plugged", "status": "completed", "tag": "a8d6e540-db2d-4268-b805-0a7b254ab005"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:43.014690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-56867f56-71b3-4de7-ab26-4ef2a45e9dc8 req-ce3b5877-4cec-4584-b162-599d7d006a0c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:43.015789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-56867f56-71b3-4de7-ab26-4ef2a45e9dc8 req-ce3b5877-4cec-4584-b162-599d7d006a0c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:43.026957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-56867f56-71b3-4de7-ab26-4ef2a45e9dc8 req-ce3b5877-4cec-4584-b162-599d7d006a0c service nova] Creating event network-vif-plugged:a8d6e540-db2d-4268-b805-0a7b254ab005 for instance 9966850f-458c-4317-ab66-5b231051af76 on hv-cinder-84684 Jul 07 04:08:43.031971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-56867f56-71b3-4de7-ab26-4ef2a45e9dc8 req-ce3b5877-4cec-4584-b162-599d7d006a0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029391 Jul 07 04:08:43.033153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 501/975] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:08:43.922187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:43.922803 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:43.929267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:43.929716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:43.930476 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:43.930912 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:44.062857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:44.066464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:44.071237 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-91353867-02ea-4719-8aa1-2e76580f95cf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.153492 Jul 07 04:08:44.071807 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 475/976] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:43 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:45.089845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:45.090520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:45.098913 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:45.099733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:45.101089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:45.101798 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:45.123211 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:45.241799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:45.249232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c754e01e-c54b-4af6-a2cb-128b3ae9c756 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1265 microversion: 2.1 time: 0.164203 Jul 07 04:08:45.249791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 502/977] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:45 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:46.266604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:46.267223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:46.274793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:46.275237 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:46.275992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:46.276458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:46.408324 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:46.415764 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5e8f3b10-2197-4387-b823-439ade3c7c4c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1452 microversion: 2.1 time: 0.153063 Jul 07 04:08:46.416345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 476/978] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:46 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:46.432531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:08:46.433148 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:08:46.440829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:46.441288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:46.442058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:46.442500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:46.574903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:08:46.582291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3facccd9-8ac1-4407-bfa6-ca8efe28815e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1452 microversion: 2.1 time: 0.153678 Jul 07 04:08:46.582845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 503/979] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:08:46 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:08:48.169359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-f784a920-30a7-4091-9805-11ec629bff45 req-68903dfd-4c52-4cb2-ba7e-0f70aad65cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9966850f-458c-4317-ab66-5b231051af76", "tag": "a8d6e540-db2d-4268-b805-0a7b254ab005"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:08:48.178028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-f784a920-30a7-4091-9805-11ec629bff45 req-68903dfd-4c52-4cb2-ba7e-0f70aad65cf8 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:08:48.178028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-f784a920-30a7-4091-9805-11ec629bff45 req-68903dfd-4c52-4cb2-ba7e-0f70aad65cf8 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:08:48.190384 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-f784a920-30a7-4091-9805-11ec629bff45 req-68903dfd-4c52-4cb2-ba7e-0f70aad65cf8 service nova] Creating event network-changed:a8d6e540-db2d-4268-b805-0a7b254ab005 for instance 9966850f-458c-4317-ab66-5b231051af76 on hv-cinder-84684 Jul 07 04:08:48.195458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-f784a920-30a7-4091-9805-11ec629bff45 req-68903dfd-4c52-4cb2-ba7e-0f70aad65cf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030093 Jul 07 04:08:48.196049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 477/980] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:09:51.564479 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:51.565230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=8 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:51.766989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:51.767490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:51.773409 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:51.773854 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:51.774607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:51.775044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:51.797052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6a0141ef-731a-4bef-972b-84c966e91069 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/ips" status: 200 len: 151 microversion: 2.20 time: 0.234295 Jul 07 04:09:51.797601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 504/981] 10.222.0.20 () {60 vars in 1288 bytes} [Thu Jul 7 04:09:51 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/ips => generated 151 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 04:09:54.669545 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:54.670282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=8 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:54.675169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:09:54.675826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:54.683839 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:54.684314 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:54.685148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:54.685583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:54.708248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lazy-loading 'flavor' on Instance uuid bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:09:54.973792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bd75fa84-9434-4c0c-9145-2f89936f132a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/action" status: 202 len: 0 microversion: 2.20 time: 0.306065 Jul 07 04:09:54.974551 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 478/982] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jul 7 04:09:54 2022] POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:09:54.982761 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:54.983367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:54.989489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:54.989969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:54.990711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:54.991134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:55.124711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:55.133312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:55.134869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:55.136038 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-65ca51f7-2396-4309-a6dd-e893dcf2bd0d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.157158 Jul 07 04:09:55.136634 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 505/983] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:09:54 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:09:56.155452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:56.156156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:56.162562 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:56.163000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:56.163944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:56.164403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:56.297291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:56.305655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:56.307135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:56.308298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-578d6f1b-1d52-44e7-9344-16dfc9b3c61c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.157636 Jul 07 04:09:56.308853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 479/984] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:09:56 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:09:57.326576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:57.327222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:57.334808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:57.335611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:57.336795 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:57.337241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:57.464528 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:57.472526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:57.474030 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:57.475187 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-37458f1d-6584-4037-8561-59ecc6b6d140 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.152648 Jul 07 04:09:57.476006 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 506/985] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:09:57 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:09:58.493643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:58.494247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:58.500671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:58.501112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:58.501857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:58.502286 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:58.631382 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:58.639721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:58.641255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:58.642418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8416fd26-ffa0-4968-a703-f5873070fd2f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.152693 Jul 07 04:09:58.642983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 480/986] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:09:58 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:09:59.662073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:09:59.662688 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:09:59.669423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:59.669868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:59.670636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:09:59.671073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:09:59.799521 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:59.807644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:59.809183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:09:59.810339 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ea96ce06-3854-47d1-a494-f20169fa50f7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.152565 Jul 07 04:09:59.810912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 507/987] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:09:59 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:00.069282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:00.070445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:00.076931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:00.077377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:00.078133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:00.078566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:00.101116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-515a14d0-bee1-47de-b1b1-41790dd0fd85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/ips" status: 200 len: 150 microversion: 2.1 time: 0.035336 Jul 07 04:10:00.101830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 481/988] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:10:00 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:00.829480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:00.830094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:00.836961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:00.837410 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:00.838165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:00.838596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:00.968999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:00.977125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:00.978628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:00.979776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6d63241f-f57d-4288-90bb-f2f5e3dcc5b1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.154231 Jul 07 04:10:00.980358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 508/989] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:00 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:01.998555 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:01.999069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:02.005684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:02.006130 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:02.006998 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:02.007512 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:02.133882 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:02.141731 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:02.143212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:02.144398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4b51d97e-bef0-48c8-9e93-59f45204c300 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.149786 Jul 07 04:10:02.144958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 482/990] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:01 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:02.488391 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb31b054-b00a-4684-b95b-8bc7bffbd94c"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:02.489503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:02.496041 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:02.496521 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:02.497274 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:02.497705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:02.747719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5cfa7c4b-2edd-4ef0-b34f-343bbc77fe91 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263065 Jul 07 04:10:02.748352 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 509/991] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:10:02 2022] POST /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:03.163019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:03.164243 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:03.170759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:03.171205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:03.171951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:03.172422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:03.306370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:03.314393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:03.315961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:03.317196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-35dbb9bc-cfc7-4fc0-a120-e379e286e37d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.158139 Jul 07 04:10:03.317798 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 483/992] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:03 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:04.338077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:04.338777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:04.344967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:04.345426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:04.346179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:04.346610 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:04.479584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:04.487510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:04.489048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:04.490197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eb304baf-9e7a-442b-95e9-5afbc9872d8c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.157531 Jul 07 04:10:04.490757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 510/993] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:04 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:05.509166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:05.509750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:05.516253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:05.516724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:05.517473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:05.517902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:05.644353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:05.652754 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:05.654250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:05.655414 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-97d3d4b9-a58d-42d3-aa7a-96b5270de777 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.150973 Jul 07 04:10:05.655973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 484/994] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:05 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:06.674017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:06.674628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:06.681593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:06.682043 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:06.682797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:06.683235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:06.823197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:06.831022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:06.832550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:06.833705 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a1534f3e-2abe-48d8-8082-a1f4be4a8a87 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.163596 Jul 07 04:10:06.834271 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 511/995] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:06 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:07.853348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:07.854053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:07.860483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:07.860931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:07.861693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:07.862131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:07.908628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:07.909135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:07.915165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:07.915605 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:07.916398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:07.916827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:07.939849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-da127842-1549-4618-a02c-4d0840d6f7a2 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/ips" status: 200 len: 147 microversion: 2.1 time: 0.173645 Jul 07 04:10:07.940421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 485/996] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:10:07 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/ips => generated 147 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:07.997001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:08.004635 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:08.006507 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:08.007730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7e80215d-814d-4939-b04b-c916d1722c98 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.159375 Jul 07 04:10:08.008531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 512/997] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:07 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:09.026698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:09.027331 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:09.033856 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:09.034313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:09.035072 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:09.035511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:09.162345 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:09.170464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:09.171964 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:09.173145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-188edd25-3220-4e4a-bea5-9343f70fc143 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.150477 Jul 07 04:10:09.173703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 486/998] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:09 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:10.191789 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:10.192434 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:10.198904 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:10.199359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:10.200122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:10.200589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:10.236329 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2a834cf0-682d-4a66-a6f6-ac9558b3093b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: .version_select at 0x7ff6555b09d0>, body: {"keypair": {"name": "tempest-keypair-1585101811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuq2W/HC2sVA+wSqbqcCMUCMNbdPKZrRazJo3TUJ1VProXuxrl7V1SwRWvfEQmCEVt7t6lkWXxgjyR4Xc/LYffoJZoQHyKYAJFWikH6cqlRMa+I0+tx4sS8UHpTX1Cmqg=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:10.251266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-2a834cf0-682d-4a66-a6f6-ac9558b3093b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:10:10.255033 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-2a834cf0-682d-4a66-a6f6-ac9558b3093b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:10:10.277332 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2a834cf0-682d-4a66-a6f6-ac9558b3093b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044590 Jul 07 04:10:10.278157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 487/999] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:10:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:10:10.325542 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7879e5bf-5cd2-42f6-acc4-137bba8ec7a0"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:10.326884 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:10.333566 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:10.334075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:10.335139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:10.335679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:10.343510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:10.352792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:10.354601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:10.356044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2602bbcf-5379-42c0-a963-d7544b2f47c1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.168049 Jul 07 04:10:10.358509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 513/1000] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:10 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:10.619046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1a3b1741-0c4e-4a04-90dc-0ed8b0f7ab22 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298038 Jul 07 04:10:10.619667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 488/1001] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:10:10 2022] POST /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:10:11.097694 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:10:11.097906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:10:11.375387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:11.376058 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:11.383954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:11.384410 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:11.385172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:11.385605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:11.538761 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:11.542991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:11.544507 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:11.545731 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18aaa2fc-8f8a-49e3-8fe0-bedec2e4f269 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.174227 Jul 07 04:10:11.546215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 514/1002] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:11 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:11.629078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-726633193", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb43ae82-16c6-4173-a04e-f756cd39db29"}], "security_groups": [{"name": "tempest-securitygroup--1989619201"}], "key_name": "tempest-keypair-1585101811", "user_data": "}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:11.731769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] validate_networks() for [('eb43ae82-16c6-4173-a04e-f756cd39db29', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:10:12.154389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:10:12.154814 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:10:12.155289 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:10:12.155699 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:10:12.156112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:10:12.165584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:12.166034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:12.166830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:12.167267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:12.183494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:10:12.187377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:10:12.198255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:10:12.200652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:10:12.245861 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR oslo.messaging._drivers.impl_rabbit [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [e02b0229-e23f-4a87-b905-41fec8dd13ef] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 04:10:12.569833 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:12.570702 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:12.577250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:12.577695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:12.578447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:12.578877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:12.714715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:12.722492 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:12.723969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:12.725141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18904b0d-718a-4893-ae93-b35fcfe99024 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.159721 Jul 07 04:10:12.725821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 515/1003] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:12 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:13.252421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [e02b0229-e23f-4a87-b905-41fec8dd13ef] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56284. Jul 07 04:10:13.256302 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-70e4c30a-5ab8-476d-b32d-1749c2cca3cd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.632496 Jul 07 04:10:13.256954 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 489/1004] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:10:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:10:13.266689 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-66980218-8a2a-479c-a77e-eebafb435b0a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:13.267293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-66980218-8a2a-479c-a77e-eebafb435b0a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:13.326788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-66980218-8a2a-479c-a77e-eebafb435b0a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:13.333505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-66980218-8a2a-479c-a77e-eebafb435b0a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1241 microversion: 2.1 time: 0.070574 Jul 07 04:10:13.334077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 516/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:13 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:13.744964 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:13.745584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:13.752251 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:13.752649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:13.753418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:13.753855 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:13.886967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:13.894858 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:13.896388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:13.898370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5264a027-ea6b-4dfc-8d22-31f5cd556fbb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.157544 Jul 07 04:10:13.898932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 490/1006] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:13 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:14.350476 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:14.352370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:14.358580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:14.359023 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:14.359774 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:14.360207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:14.419940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:14.427202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-47d9dbce-c862-4e43-9514-24ab873ba69c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1245 microversion: 2.1 time: 0.080591 Jul 07 04:10:14.427753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 517/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:14 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:14.917703 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:14.918600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:14.925648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:14.926100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:14.926871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:14.927305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:15.067230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:15.075406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:15.076928 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:15.078074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0a1511ac-e756-43ee-909e-b6189f0bb1a0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.165257 Jul 07 04:10:15.078630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 491/1008] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:14 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:15.446548 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:15.447892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:15.457957 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:15.458425 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:15.459813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:15.462366 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:15.559363 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:15.567255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5d9981cc-4228-4c63-8745-3422130f9627 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1301 microversion: 2.1 time: 0.125328 Jul 07 04:10:15.567835 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 518/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:15 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:16.097137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:16.097909 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:16.105809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:16.106341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:16.107187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:16.107698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:16.527977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:16.536159 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:16.537704 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:16.539446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-142ce7b5-1380-4dff-9d30-690a595974f6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.446295 Jul 07 04:10:16.540005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 492/1010] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:16 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:16.586856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:16.588210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:16.594953 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:16.595405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:16.596249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:16.596716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:16.746752 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:16.754572 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-de26ce77-d2d4-4465-8c8f-3b58062a1821 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.173073 Jul 07 04:10:16.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 519/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:16 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:17.494841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-e7ee7ac5-c787-45e2-bbe7-4c9f5e70a8b4 req-099e6ae7-c36a-4654-bb0c-ba0736e63a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "name": "network-vif-plugged", "status": "completed", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:17.503071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-e7ee7ac5-c787-45e2-bbe7-4c9f5e70a8b4 req-099e6ae7-c36a-4654-bb0c-ba0736e63a8b service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:17.503511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-e7ee7ac5-c787-45e2-bbe7-4c9f5e70a8b4 req-099e6ae7-c36a-4654-bb0c-ba0736e63a8b service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:17.514479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-e7ee7ac5-c787-45e2-bbe7-4c9f5e70a8b4 req-099e6ae7-c36a-4654-bb0c-ba0736e63a8b service nova] Creating event network-vif-plugged:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:10:17.519481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-e7ee7ac5-c787-45e2-bbe7-4c9f5e70a8b4 req-099e6ae7-c36a-4654-bb0c-ba0736e63a8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087404 Jul 07 04:10:17.520051 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 493/1012] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:17.558384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:17.558987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:17.565036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:17.565480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:17.566230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:17.566657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:17.584633 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:17.700019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:17.707800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:17.709320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:17.711368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-48cf15bf-f2ed-48d3-8adf-2fe8e1cab1ac tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.156825 Jul 07 04:10:17.711984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 520/1013] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:17 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:17.775482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:17.776187 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:17.782397 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:17.782845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:17.783605 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:17.784041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:17.788075 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:17.977017 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:17.984458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5afd49a7-6e3e-422e-b8cd-991f492dc205 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.214033 Jul 07 04:10:17.985019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 494/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:17 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:18.577915 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-a1ddc786-9e26-4b9f-9812-28dada3de3f6 req-3e9f5d4a-10f9-413f-b4d0-2ac733a0d5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76e2aeb-a40d-49ce-81b1-3248e45c25f2", "tag": "2de171c4-6bac-4d53-a9e6-9a18419d949f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:18.588154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a1ddc786-9e26-4b9f-9812-28dada3de3f6 req-3e9f5d4a-10f9-413f-b4d0-2ac733a0d5ea service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:18.589053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a1ddc786-9e26-4b9f-9812-28dada3de3f6 req-3e9f5d4a-10f9-413f-b4d0-2ac733a0d5ea service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:18.601798 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-a1ddc786-9e26-4b9f-9812-28dada3de3f6 req-3e9f5d4a-10f9-413f-b4d0-2ac733a0d5ea service nova] Creating event network-changed:2de171c4-6bac-4d53-a9e6-9a18419d949f for instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 on hv-cinder-84684 Jul 07 04:10:18.607931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-a1ddc786-9e26-4b9f-9812-28dada3de3f6 req-3e9f5d4a-10f9-413f-b4d0-2ac733a0d5ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108548 Jul 07 04:10:18.609237 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 521/1015] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:18.729771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:18.730395 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:18.736979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:18.737428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:18.738180 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:18.738610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:18.946099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:18.954027 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:18.955515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:18.956833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-37c58717-b51e-404e-8265-c7c7858354a5 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.231616 Jul 07 04:10:18.957279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 495/1016] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:18 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:19.002711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:19.003445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:19.009898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.010344 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.011098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.011528 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.155157 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:19.162823 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-241c5175-3661-4724-b008-1cde7e0e0273 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.164275 Jul 07 04:10:19.164042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 522/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:18 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:19.167706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:19.168721 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:19.174677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.175117 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.175901 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.176352 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.205642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-272983b0-36e9-4994-9b43-60c796075579 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Jul 07 04:10:19.206191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 496/1018] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:10:19 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:10:19.216575 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:19.217071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:19.222883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.223324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.224072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.224535 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.253717 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7b4b98f4-846a-4c1c-9cfb-cecfb9423997 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0" status: 200 len: 194 microversion: 2.1 time: 0.040956 Jul 07 04:10:19.254215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 523/1019] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jul 7 04:10:19 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:19.975340 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:19.976877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:19.983446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.983894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:19.984692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:19.985123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:20.121829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:20.129757 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:20.131242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:20.132677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a40bb94f-e6c7-418e-a945-933a6363e4c8 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.161114 Jul 07 04:10:20.133240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 497/1020] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:19 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:20.180124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:20.180800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:20.187235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:20.187681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:20.188485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:20.188922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:20.318370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:20.325807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-94479e03-3e6b-4e81-9111-18be46af1bcd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.149557 Jul 07 04:10:20.326368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 524/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:20 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:21.151460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:21.152073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:21.158534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.159015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:21.159766 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.160199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:21.293532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:21.301281 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:21.302763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:21.303902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ea44d19d-097c-4241-a263-4356e825e994 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.157094 Jul 07 04:10:21.304575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 498/1022] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:21 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:21.343232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:21.343850 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:21.350261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.350719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:21.351723 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.352158 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:21.482553 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:21.489992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-747170fb-4319-4928-a946-a12857dbae9d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.150659 Jul 07 04:10:21.490554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 525/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:21 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:21.609713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165f822a-7680-42b9-80c6-39701a57dbdc"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:21.610771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:21.616635 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.617078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:21.617823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:21.618254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:22.174335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:22.194053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=10 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:22.323012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:22.323630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:22.326320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=47 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:22.331734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:22.332180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:22.333050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:22.333485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:22.462082 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:22.469965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:22.471469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:22.472653 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55f2f0c6-b856-49ac-bfeb-4051e8f25a95 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.154515 Jul 07 04:10:22.473210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 526/1024] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:22 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:22.506120 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:22.506776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:22.512682 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:22.513131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:22.513888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:22.514331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:22.642803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:22.650813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0ca80fdf-efc4-48f7-a1f4-302a1080e392 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.148204 Jul 07 04:10:22.651375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 527/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:22 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:23.491313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:23.492032 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:23.493970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:23.499727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:23.500180 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:23.501020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:23.501451 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:23.636212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:23.644241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:23.645802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:23.646946 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8353c1c0-1258-4f42-be51-c2baffb3e77f tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1744 microversion: 2.20 time: 0.159967 Jul 07 04:10:23.648188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 528/1026] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:23 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:23.666541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:23.667142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:23.672944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:23.673392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:23.674131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:23.674558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:23.807907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:23.815337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ab2a79c1-361f-47b2-9ca7-ad6dfee331f0 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.152538 Jul 07 04:10:23.815906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 529/1027] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:23 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:24.249267 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ac3c3451-47ef-4af2-bbee-17e5aa56ba24 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "POST /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.643196 Jul 07 04:10:24.250906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 499/1028] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:10:21 2022] POST /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 194 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:24.668111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:24.668876 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:24.675801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:24.676256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:24.677259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:24.677706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:24.835506 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:24.836423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:24.848526 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:24.849806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:24.859298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:24.859760 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:24.863140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:24.863433 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:24.869115 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:24.871390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:24.876087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-95d9c481-8717-43f7-8e9d-be49a8972ff4 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.212494 Jul 07 04:10:24.890690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 530/1029] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:24 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:25.050510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:25.060525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e26cec1b-e6bf-4d76-911b-256bd2f5ca75 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.230698 Jul 07 04:10:25.061676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 500/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:24 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:25.609268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-25b65cdb-9558-426e-9d44-01ae4ee7ee7e req-e38daf38-8733-47ae-83e9-e86041507cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76e2aeb-a40d-49ce-81b1-3248e45c25f2", "name": "network-vif-plugged", "status": "completed", "tag": "2de171c4-6bac-4d53-a9e6-9a18419d949f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:25.620590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-25b65cdb-9558-426e-9d44-01ae4ee7ee7e req-e38daf38-8733-47ae-83e9-e86041507cd1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:25.621149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-25b65cdb-9558-426e-9d44-01ae4ee7ee7e req-e38daf38-8733-47ae-83e9-e86041507cd1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:25.637504 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-25b65cdb-9558-426e-9d44-01ae4ee7ee7e req-e38daf38-8733-47ae-83e9-e86041507cd1 service nova] Creating event network-vif-plugged:2de171c4-6bac-4d53-a9e6-9a18419d949f for instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 on hv-cinder-84684 Jul 07 04:10:25.643713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-25b65cdb-9558-426e-9d44-01ae4ee7ee7e req-e38daf38-8733-47ae-83e9-e86041507cd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037880 Jul 07 04:10:25.645337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 531/1031] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:25.909000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:25.910453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:25.918956 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:25.919513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:25.920429 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:25.921146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:26.072169 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:26.079905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:26.080905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:26.082291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:26.084013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:26.086438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5c0d6719-925c-4eb1-bace-c23018178275 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.181476 Jul 07 04:10:26.091790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:26.092780 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:26.093877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:26.094606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:26.099511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 501/1032] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:25 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:26.246790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:26.254952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b98d122-e4e3-45f4-ac27-7326054f5bde tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.179478 Jul 07 04:10:26.255627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 532/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:26 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:27.107602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:27.108213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:27.117879 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:27.118607 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:27.119374 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:27.119934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:27.270392 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:27.271267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:27.271961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:27.279209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:27.279746 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:27.280776 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:27.280927 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:27.281605 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:27.282582 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:27.283760 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bbd7e6ed-232e-417b-a8ec-9ae1f73419c0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.180116 Jul 07 04:10:27.295687 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 502/1034] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:27 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:27.417405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:27.425384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-54172b15-81e8-4c6a-896a-a2673c9f1acd tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.158113 Jul 07 04:10:27.431947 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 533/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:27 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:28.301938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:28.303190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:28.311049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:28.312153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:28.314035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:28.315483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:28.442443 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:28.443836 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:28.460509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:28.462140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:28.463253 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:28.463911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:28.554330 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:28.566924 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:28.572463 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:28.582744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0e56017c-6ba3-4f89-b7e4-a824a9ce0073 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.284721 Jul 07 04:10:28.583331 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 503/1036] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:28 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:28.700990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:28.709387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b5c7b5c4-5e6e-4a2b-bbf9-ef4b98ab07a8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1367 microversion: 2.1 time: 0.270878 Jul 07 04:10:28.711147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 534/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:28 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:29.603561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:29.604158 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:29.612171 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.612874 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:29.613835 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.614247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:29.728384 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:29.729636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:29.736715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.737426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:29.738399 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.738842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:29.770690 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:29.780093 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:29.781683 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:29.782870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bca1f6c9-a99a-4101-859f-72b888f8cbca tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.184297 Jul 07 04:10:29.783420 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 504/1038] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:29 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:29.907826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:29.917197 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fdb9eb2e-9136-4cb1-8c87-f0e3255de2da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1558 microversion: 2.1 time: 0.194132 Jul 07 04:10:29.918552 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 535/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:29 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:29.936953 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:29.937570 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:29.945113 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.946709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:29.947366 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:29.947811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:30.033004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-705f287d-fa76-44e7-8890-94f058661b03 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100332 Jul 07 04:10:30.034223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 505/1040] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:10:29 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:30.803013 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:30.804198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:30.811870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:30.812781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:30.813807 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:30.814469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:31.036382 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:31.045734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:31.047372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:31.048892 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-13fd872f-cedc-4de9-8f29-18d6e0d74784 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.249649 Jul 07 04:10:31.060602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 536/1041] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:30 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:31.211611 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-9274c586-a265-4c4a-adfa-02ca5c13c3ea req-be051cc2-94d5-4d3b-9f4e-a388adef776c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76e2aeb-a40d-49ce-81b1-3248e45c25f2", "tag": "2de171c4-6bac-4d53-a9e6-9a18419d949f"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:31.222472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-9274c586-a265-4c4a-adfa-02ca5c13c3ea req-be051cc2-94d5-4d3b-9f4e-a388adef776c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:31.223228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-9274c586-a265-4c4a-adfa-02ca5c13c3ea req-be051cc2-94d5-4d3b-9f4e-a388adef776c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:31.237543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-9274c586-a265-4c4a-adfa-02ca5c13c3ea req-be051cc2-94d5-4d3b-9f4e-a388adef776c service nova] Creating event network-changed:2de171c4-6bac-4d53-a9e6-9a18419d949f for instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 on hv-cinder-84684 Jul 07 04:10:31.243743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-9274c586-a265-4c4a-adfa-02ca5c13c3ea req-be051cc2-94d5-4d3b-9f4e-a388adef776c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038496 Jul 07 04:10:31.244700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 506/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:32.069603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:32.070743 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:32.077442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:32.078200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:32.079175 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:32.079768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:32.583824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:32.593681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:32.597048 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:32.598237 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-af33ee06-7543-41e2-9e39-7c8cf0cdffc3 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.532793 Jul 07 04:10:32.599114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 537/1043] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:32 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:32.940077 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:32.941285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:32.948632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:32.949085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:32.949853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:32.950342 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:32.983622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-be7d68a4-4456-4163-b938-903be1d1355b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049021 Jul 07 04:10:32.984710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 507/1044] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:10:32 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:33.138825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:33.140073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:33.147000 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.148075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.149019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.149671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.167116 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:33.182852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c3e2b1fb-67eb-4f0e-b142-813fd3f997ed tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0" status: 200 len: 194 microversion: 2.1 time: 0.047853 Jul 07 04:10:33.183460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 538/1045] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jul 7 04:10:33 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:33.194038 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:33.195671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:33.202572 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.203291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.204402 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.205023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.304488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lazy-loading 'services' on Instance uuid d106975f-a8a3-4bbe-95a5-ccfa1015eea6 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:10:33.409526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-59676444-8db3-473d-8258-bbbc3d2915e8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0" status: 202 len: 0 microversion: 2.1 time: 0.220142 Jul 07 04:10:33.410782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 508/1046] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:10:33 2022] DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/7879e5bf-5cd2-42f6-acc4-137bba8ec7a0 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:10:33.618501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:33.619574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:33.625692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.626342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.627279 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:33.627711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:33.766773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:33.775478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:33.777012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:33.778170 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b9bbe07-2fc8-42ff-a8c0-38333fb8489c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.164321 Jul 07 04:10:33.778722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 539/1047] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:33 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:34.799351 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:34.799985 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:34.810447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:34.810910 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:34.811712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:34.812165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:35.002838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:35.007045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:35.016715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:35.020200 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:35.021526 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9a57654a-4977-4393-ac81-adcfa9770b40 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.227374 Jul 07 04:10:35.022665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 509/1048] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:34 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:35.602940 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:35.603426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:35.609845 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:35.610324 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:35.611084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:35.611519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:35.639895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f4b3c72a-979b-4176-9881-f02e21101c98 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/165f822a-7680-42b9-80c6-39701a57dbdc" status: 200 len: 194 microversion: 2.1 time: 0.041870 Jul 07 04:10:35.640497 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 540/1049] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jul 7 04:10:35 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/165f822a-7680-42b9-80c6-39701a57dbdc => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:35.650597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:35.651097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:35.657633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:35.658078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:35.658834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:35.659270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:35.738054 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lazy-loading 'services' on Instance uuid d106975f-a8a3-4bbe-95a5-ccfa1015eea6 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:10:35.810059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-315cbcc8-e3cd-4ba7-916e-18eab97ca39b tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/165f822a-7680-42b9-80c6-39701a57dbdc" status: 202 len: 0 microversion: 2.1 time: 0.163666 Jul 07 04:10:35.810710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 510/1050] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:10:35 2022] DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments/165f822a-7680-42b9-80c6-39701a57dbdc => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:10:36.043172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:36.043817 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:36.049787 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:36.050235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:36.050988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:36.051422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:36.180871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:36.188661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:36.190148 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:36.191296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-87ea5688-9383-4189-b9f8-9358a00d12db tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1739 microversion: 2.20 time: 0.152127 Jul 07 04:10:36.191851 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 541/1051] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:36 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:37.210753 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:37.211545 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:37.218361 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:37.218805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:37.219559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:37.219992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:37.353470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:37.361604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:37.363119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:37.364302 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c4feeae6-2949-4e23-87f1-677b3625c2ae tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1721 microversion: 2.20 time: 0.158441 Jul 07 04:10:37.364873 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 511/1052] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:37 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:38.021343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:38.022202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:38.029221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.029671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.030427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.030865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.058750 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2854b00a-4e50-4534-85ec-88101a67b962 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041316 Jul 07 04:10:38.059294 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 542/1053] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:10:38 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:10:38.161184 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:38.162165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:38.168552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.169021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.169826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.170270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.202603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-74ef5524-cc0b-4038-a800-56a8f989c644 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045251 Jul 07 04:10:38.203163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 512/1054] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:10:38 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:10:38.260370 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:38.260876 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:38.266800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.267252 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.268011 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.268479 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.292647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:10:38.365710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-33eeed52-3c94-4809-8959-4f966db88442 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 204 len: 0 microversion: 2.1 time: 0.110054 Jul 07 04:10:38.366864 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 543/1055] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:10:38 2022] DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:10:38.375197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:38.375836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:38.383126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.383551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:38.383817 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.384290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:38.384616 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.385053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.390125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.390573 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.391367 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:38.391822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:38.573640 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:38.581141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c0501f04-0ef4-4cb1-9546-1619fac9c795 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1671 microversion: 2.1 time: 0.209735 Jul 07 04:10:38.582094 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 513/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:38 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1671 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:38.584318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:38.592154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:38.593674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:38.594813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-43bd77cd-4028-461d-8f74-2e47b2f71a26 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1721 microversion: 2.20 time: 0.216072 Jul 07 04:10:38.595353 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 544/1057] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:38 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:39.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:39.599390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:39.606894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:39.608131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-328ea14d-41c7-4d1b-82e5-2364b6ee2596 req-5fe106bc-d27a-483b-bcca-6f3ad43de2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "name": "network-vif-unplugged", "status": "completed", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:39.608634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:39.608978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:39.609420 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:39.617486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-328ea14d-41c7-4d1b-82e5-2364b6ee2596 req-5fe106bc-d27a-483b-bcca-6f3ad43de2c7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:39.618503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-328ea14d-41c7-4d1b-82e5-2364b6ee2596 req-5fe106bc-d27a-483b-bcca-6f3ad43de2c7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:39.631450 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-328ea14d-41c7-4d1b-82e5-2364b6ee2596 req-5fe106bc-d27a-483b-bcca-6f3ad43de2c7 service nova] Creating event network-vif-unplugged:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:10:39.636921 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-328ea14d-41c7-4d1b-82e5-2364b6ee2596 req-5fe106bc-d27a-483b-bcca-6f3ad43de2c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032626 Jul 07 04:10:39.637519 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 545/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:39.642724 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:39.643371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:39.650534 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:39.650992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:39.651778 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:39.652210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:39.806597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:39.814078 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9533ef5f-1005-4ade-9456-002e2151dc61 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1671 microversion: 2.1 time: 0.219279 Jul 07 04:10:39.814659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 514/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:39 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:39.831395 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:39.839895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:39.841674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:39.842824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-72d77ffa-00d7-488a-821e-5bc1168be387 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1721 microversion: 2.20 time: 0.204066 Jul 07 04:10:39.843372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 546/1060] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:39 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:40.830959 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:40.831750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:40.838743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:40.839261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:40.840045 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:40.840509 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:40.861098 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:40.861812 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:40.869679 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:40.870221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:40.871094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:40.871613 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.037624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:41.045719 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ff22cb28-b616-47b7-96d5-b84227209d50 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1671 microversion: 2.1 time: 0.218611 Jul 07 04:10:41.046287 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 515/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:40 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:10:41.056079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:41.063917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:41.065449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:41.066599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6281145d-59b7-4b54-bc29-75dd5814442a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1724 microversion: 2.20 time: 0.209396 Jul 07 04:10:41.067150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 547/1062] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:40 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:41.084089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf7c915-7693-4961-a920-e85addde4835"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:41.085246 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:41.091198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.091647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.092441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.092878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.369221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d042ba93-8c58-4239-8fbf-1ea416735889 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288971 Jul 07 04:10:41.370739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 516/1063] 10.222.0.20 () {62 vars in 1363 bytes} [Thu Jul 7 04:10:41 2022] POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 04:10:41.485398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:41.485974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:41.492205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.492785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.493727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.494167 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.740658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-933a4e7b-9fc2-472c-9312-d4c55b746ebf tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments/caf7c915-7693-4961-a920-e85addde4835" status: 202 len: 0 microversion: 2.20 time: 0.260771 Jul 07 04:10:41.741360 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 548/1064] 10.222.0.20 () {60 vars in 1456 bytes} [Thu Jul 7 04:10:41 2022] DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments/caf7c915-7693-4961-a920-e85addde4835 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:10:41.806939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:41.807518 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:41.814283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.814735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.815504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.815941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.893415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-71a1c1b9-f284-47c6-99be-680f53520571 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/action" status: 202 len: 0 microversion: 2.20 time: 0.090683 Jul 07 04:10:41.894715 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 517/1065] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jul 7 04:10:41 2022] POST /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:10:41.903096 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:41.903706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:41.912328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.912858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:41.913648 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:41.914179 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:42.062990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:42.063622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:42.070264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:42.072994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:42.073834 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:42.074620 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:42.075131 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:42.091402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:42.096564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:42.098152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-895c3ea1-a17d-4d83-85aa-a23467e3afde tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1672 microversion: 2.20 time: 0.199046 Jul 07 04:10:42.099003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 549/1066] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:41 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:42.262529 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4562cd7ed5c845ce883667028a42fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc78ef06a31540ebb996ccb4a6a160f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:42.272098 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-82eddbac-4129-4dc1-939c-f33f1c6d1ec1 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 200 len: 1671 microversion: 2.1 time: 0.212925 Jul 07 04:10:42.272918 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 518/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:42 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 1671 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:10:42.709696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-58885eb9-945c-40ba-a626-dc49e55b2c7f req-7d40032f-67a4-4526-87a3-468c39c6d8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d106975f-a8a3-4bbe-95a5-ccfa1015eea6", "name": "network-vif-deleted", "tag": "22d36d0a-08e1-476a-9fd1-66cf1abaed74"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:10:42.719857 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-58885eb9-945c-40ba-a626-dc49e55b2c7f req-7d40032f-67a4-4526-87a3-468c39c6d8d7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:42.721044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-58885eb9-945c-40ba-a626-dc49e55b2c7f req-7d40032f-67a4-4526-87a3-468c39c6d8d7 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:42.739210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-58885eb9-945c-40ba-a626-dc49e55b2c7f req-7d40032f-67a4-4526-87a3-468c39c6d8d7 service nova] Creating event network-vif-deleted:22d36d0a-08e1-476a-9fd1-66cf1abaed74 for instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 on hv-cinder-84684 Jul 07 04:10:42.750803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-58885eb9-945c-40ba-a626-dc49e55b2c7f req-7d40032f-67a4-4526-87a3-468c39c6d8d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117645 Jul 07 04:10:42.751664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 550/1068] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:10:43.122176 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:43.122744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:43.129726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:43.130183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:43.130960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:43.131403 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:43.293063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:43.294489 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:43.302596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:43.314803 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:43.315358 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:43.316207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:43.316347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:43.316822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:43.317934 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:43.319224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-497893d3-ae40-4f0b-9728-94bb28abe874 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1674 microversion: 2.20 time: 0.203880 Jul 07 04:10:43.319975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 519/1069] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:43 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:43.342600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 HTTP/1.1 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:10:43.344305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:43.346084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'd106975f-a8a3-4bbe-95a5-ccfa1015eea6'} Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:10:43.347033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:43.349241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:43.350700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:10:43.350700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0d543f8b-958c-4708-8d41-39fe8f2f923f tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 404 len: 111 microversion: 2.1 time: 0.059203 Jul 07 04:10:43.350700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 551/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:43 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:10:43.361132 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8cb51e71-0f70-4cc0-a399-1fcab6618aa4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '.version_select at 0x7ff655496790>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:43.382018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8cb51e71-0f70-4cc0-a399-1fcab6618aa4 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59945119" status: 202 len: 0 microversion: 2.1 time: 0.026472 Jul 07 04:10:43.382527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 520/1071] 10.222.0.20 () {58 vars in 1214 bytes} [Thu Jul 7 04:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59945119 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:10:44.338739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:44.339382 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:44.345796 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:44.346235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:44.346989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:44.347420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:44.481961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:44.490480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:44.491983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:44.493755 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e12d37c7-096e-45c5-9261-9262b466cae6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.159096 Jul 07 04:10:44.494340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 552/1072] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:44 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:45.512829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:45.513663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:45.520154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:45.520937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:45.521936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:45.522641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:45.673904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:45.683290 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:45.685157 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:45.686333 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8768a128-a9f6-42f2-b088-cfbe7b5c0cb0 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.178964 Jul 07 04:10:45.686898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 521/1073] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:45 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:46.393099 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:46.393624 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:46.413486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.415295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.416422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.417065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.420072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:46.434097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 HTTP/1.1 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:10:46.436183 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.437865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'd106975f-a8a3-4bbe-95a5-ccfa1015eea6'} Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:10:46.438772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.440255 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.443486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:10:46.444551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0f25176f-077d-49c7-a72d-5e97ba5e1d6d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 404 len: 111 microversion: 2.1 time: 0.055622 Jul 07 04:10:46.445659 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 553/1074] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:10:46 2022] DELETE /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:10:46.453326 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:46.453975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: d106975f-a8a3-4bbe-95a5-ccfa1015eea6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:46.460242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.460929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.462234 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.462842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.477388 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 HTTP/1.1 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:10:46.479194 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.480878 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'd106975f-a8a3-4bbe-95a5-ccfa1015eea6'} Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:10:46.481787 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. Jul 07 04:10:46.483657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:46.485641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance d106975f-a8a3-4bbe-95a5-ccfa1015eea6 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:10:46.485641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6b3aec65-4a1e-4761-9771-4058ad1b1c7d tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6" status: 404 len: 111 microversion: 2.1 time: 0.031163 Jul 07 04:10:46.485641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 522/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:46 2022] GET /compute/v2.1/servers/d106975f-a8a3-4bbe-95a5-ccfa1015eea6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:10:46.706080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:46.706694 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:46.712923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.713379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.714155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:46.714595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:46.856935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:46.866036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:46.868785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:46.870100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b81415fd-64cf-41ab-a8b1-7a70f3f42596 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.168275 Jul 07 04:10:46.874949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 554/1076] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:46 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:47.642050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:47.642676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:47.650792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.651377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.652262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.652825 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.667047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 HTTP/1.1 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:10:47.668648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.670296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '46a0e9ce-7bb6-48e1-91d6-c339089593b5'} Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:10:47.671199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.673120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.674743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:10:47.674743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2567e814-9b27-4896-84ef-9cd4a4224d99 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 404 len: 111 microversion: 2.1 time: 0.031882 Jul 07 04:10:47.674743 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 523/1077] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:10:47 2022] DELETE /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:10:47.678623 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:47.679241 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] [instance: 46a0e9ce-7bb6-48e1-91d6-c339089593b5] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:47.685935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.686390 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.687160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.687771 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.702589 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] HTTP exception thrown: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Request method failure captured: Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 HTTP/1.1 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnkUncWfWgbzvb58WpgXaGCNU6ryIe6xQwD4JfHzBYLfpv4r-6nRduo6qDteXMM57tWh3LD5Kv7Hny3pg5ZsLEiwmSLlgu4FCDXTG8ACHKOG4jQBxFWVsaQQKyoluZrLWl1zVzJOEhaI_rr_PVdJibd9bPnpISynF5Xq0bM9Aa5Fbk Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:10:47.704035 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc78ef06a31540ebb996ccb4a6a160f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fc78ef06a31540ebb996ccb4a6a160f5 Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-537381586 Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 4562cd7ed5c845ce883667028a42fb3d Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-537381586-project Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.705690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '46a0e9ce-7bb6-48e1-91d6-c339089593b5'} Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:10:47.706570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. Jul 07 04:10:47.708005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:10:47.709983 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] Returning 404 to user: Instance 46a0e9ce-7bb6-48e1-91d6-c339089593b5 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:10:47.711003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c4566b76-e84a-457d-99f4-9aa607a42eb8 tempest-AttachVolumeTestJSON-537381586 tempest-AttachVolumeTestJSON-537381586-project] 10.222.0.20 "GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5" status: 404 len: 111 microversion: 2.1 time: 0.036329 Jul 07 04:10:47.712305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 555/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:10:47 2022] GET /compute/v2.1/servers/46a0e9ce-7bb6-48e1-91d6-c339089593b5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:10:47.889357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:47.890406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:47.897419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.897963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.899747 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:47.900563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:47.921636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:48.161829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:48.170206 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:48.172178 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:48.173209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6807fa01-34c4-4c4e-81d2-1a809104d27b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.288107 Jul 07 04:10:48.174165 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 524/1079] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:47 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:49.195428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:49.197071 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:49.204186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:49.204832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:49.205773 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:49.206375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:49.435501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:49.459426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:49.461546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:49.462885 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-77d5ea30-54f5-412a-8d17-36792209d3e6 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.272584 Jul 07 04:10:49.474317 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 556/1080] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:49 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:50.482877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:50.483487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:50.490711 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:50.491472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:50.493278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:50.494127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:50.821963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:50.842590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:50.844141 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:50.845391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-77fa7d13-618f-48b3-b595-52ee632d58f2 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.366420 Jul 07 04:10:50.846176 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 525/1081] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:50 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:51.864804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:51.865419 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:51.876262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:51.877027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:51.877808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:51.878421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:52.152607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:52.171275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:52.174051 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:52.176525 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-661cd85d-1970-4595-a157-a72301cf0bc1 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.315657 Jul 07 04:10:52.189139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 557/1082] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:51 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:53.197492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:53.198127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:53.204839 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:53.205285 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:53.206047 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:53.206481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:53.349761 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:53.358992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:53.360627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:53.361860 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f362589d-2ffe-49fd-8264-0047646be49e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.168364 Jul 07 04:10:53.362493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 526/1083] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:53 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:10:54.379822 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:54.380493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:54.383465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:54.388762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:54.389204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:54.389961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:54.390392 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:54.524647 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:54.532744 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:54.534249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:54.535407 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1297bbb1-9e1a-4dec-ab40-a3afba6e4b1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.159446 Jul 07 04:10:54.535961 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 558/1084] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:54 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:55.554419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:55.555136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:55.557275 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:55.562732 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:55.563250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:55.564082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:55.564632 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:55.717070 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:55.726857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:55.728676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:55.729854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bb83eafb-5828-47c5-874d-38f648a47bad tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.179747 Jul 07 04:10:55.730453 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 527/1085] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:55 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:56.748993 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:56.749614 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:56.756014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:56.756514 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:56.757285 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:56.757728 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:56.898328 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:56.906992 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:56.908583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:56.909801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-904da1c7-995a-43d3-bea7-96db7b329c70 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.164717 Jul 07 04:10:56.910445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 559/1086] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:56 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:57.928951 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:57.929492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:57.936467 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:57.936916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:57.937671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:57.938106 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:58.070742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:58.078806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:58.080322 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:58.081487 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-756ba810-9aca-474b-b177-b7df251b0eda tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.156529 Jul 07 04:10:58.082056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 528/1087] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:57 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:10:59.098974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:10:59.099587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:10:59.106343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:59.106792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:59.107554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:10:59.107986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:10:59.239364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:59.248140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:59.249672 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:10:59.250826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8a6515b4-e7c2-4973-b078-41664600dd4b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.155807 Jul 07 04:10:59.251383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 560/1088] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:10:59 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:00.270136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:00.270749 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:00.278199 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:00.278647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:00.279423 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:00.279863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:00.416339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:00.424375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:00.426057 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:00.427327 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-08db4fce-923a-4b51-a7ca-f1788527c731 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.161347 Jul 07 04:11:00.428041 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 529/1089] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:11:00 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:01.448184 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:01.450050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:01.456398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:01.456841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:01.457681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:01.458111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:01.642145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:01.653754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:01.655413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:01.656601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c39cf662-fa21-4c5a-a22b-20cc5b4b3b0e tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.214200 Jul 07 04:11:01.657160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 561/1090] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:11:01 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:01.728695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-08f9a4d5-75b2-468b-8edd-648bf20c5847 req-757cf1e1-9d94-4e0c-9f42-54dbba50090a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "name": "network-vif-plugged", "status": "completed", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:11:01.737573 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-08f9a4d5-75b2-468b-8edd-648bf20c5847 req-757cf1e1-9d94-4e0c-9f42-54dbba50090a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:01.738014 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-08f9a4d5-75b2-468b-8edd-648bf20c5847 req-757cf1e1-9d94-4e0c-9f42-54dbba50090a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:01.749615 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-08f9a4d5-75b2-468b-8edd-648bf20c5847 req-757cf1e1-9d94-4e0c-9f42-54dbba50090a service nova] Creating event network-vif-plugged:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:11:01.754628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-08f9a4d5-75b2-468b-8edd-648bf20c5847 req-757cf1e1-9d94-4e0c-9f42-54dbba50090a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Jul 07 04:11:01.755418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 530/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:11:02.674574 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:02.675181 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:02.682419 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:02.682858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:02.683611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:02.684238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:02.814730 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:02.823797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:02.825480 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:02.826695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9aea633c-c17b-41fc-9efc-1db839dd862b tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.155911 Jul 07 04:11:02.827236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 562/1092] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:11:02 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:03.846312 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:03.847037 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:03.854546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:03.855011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:03.855765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:03.856197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:03.996259 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:04.004841 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:04.006334 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:04.007494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-04503cc8-54c6-43e0-86be-4fefd7327a5a tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1730 microversion: 2.20 time: 0.166182 Jul 07 04:11:04.008088 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 531/1093] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:11:03 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:05.026733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:05.027282 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:05.033931 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:05.034331 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:05.035124 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:05.035563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:05.172987 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:05.181059 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:05.182550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:05.183693 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8223e313-3163-48f7-928c-c3ed038a3a1c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1717 microversion: 2.20 time: 0.161355 Jul 07 04:11:05.184243 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 563/1094] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:11:05 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:11:31.537527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-384405159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1275067466", "security_groups": [{"name": "tempest-secgroup-smoke-152699616"}], "block_device_mapping_v2": [{"uuid": "819c9eb3-dc34-4df1-ba59-e79b1d225015", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e6f7a7e-402a-4bce-9487-7febb928a485"}]}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:11:31.546406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=9 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:31.547256 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=40 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:31.657449 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.network.neutron [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] validate_networks() for [('7e6f7a7e-402a-4bce-9487-7febb928a485', None, None, None, None, None)] {{(pid=117995) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:11:32.021937 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:11:32.022367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image limits 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:11:32.022848 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Flavor pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:11:32.023254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Image pref 0:0:0 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:11:32.023667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.virt.hardware [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:11:32.032464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:32.032914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:32.033706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:32.034140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:32.051458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:11:32.055357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Getting quotas for user f90b6a7eecf247ac9baa9351ae51096d and project d90ba1d25fd3421796320121b8a38fa1. Resources: {'cores', 'ram', 'instances'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:11:32.111398 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Going to run 1 instances... {{(pid=117995) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:11:32.113596 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='819c9eb3-dc34-4df1-ba59-e79b1d225015',volume_size=None,volume_type=None)] {{(pid=117995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:11:32.236606 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-da172c62-0d7f-403e-9880-22f2dc2a1836 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703062 Jul 07 04:11:32.237253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 532/1095] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:11:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:11:32.247009 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-185bf0c2-28ca-4237-8725-332983130a9c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:32.247625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-185bf0c2-28ca-4237-8725-332983130a9c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:32.249849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=11 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:32.250669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=57 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:32.306840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-185bf0c2-28ca-4237-8725-332983130a9c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:32.313649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-185bf0c2-28ca-4237-8725-332983130a9c tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1094 microversion: 2.1 time: 0.070377 Jul 07 04:11:32.314232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 564/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:32 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:33.331292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:33.331903 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:33.338676 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:33.339123 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:33.340563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:33.340997 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:33.400610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:33.408690 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b9971a70-7453-465b-b2d5-7583fe4b7d3b tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1144 microversion: 2.1 time: 0.081906 Jul 07 04:11:33.409258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 533/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:33 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:34.425500 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:34.426105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:34.432534 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:34.433551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:34.434533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:34.434979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:34.498291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:34.505674 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c1ec23f4-5be5-40ee-b02e-8bfe4a15d342 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1144 microversion: 2.1 time: 0.084026 Jul 07 04:11:34.506227 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 565/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:34 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:35.522537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:35.523154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:35.530445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:35.530892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:35.531652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:35.532090 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:35.593967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:35.601662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-db562a43-50c1-4dbd-807d-49efc138a1f8 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1144 microversion: 2.1 time: 0.083009 Jul 07 04:11:35.602229 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 534/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:35 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:36.619102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:36.619809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:36.627193 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:36.627648 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:36.628444 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:36.628887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:36.693229 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:36.701739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-14a44f1a-c3b6-4d68-bcbe-c8acf109e4c4 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1192 microversion: 2.1 time: 0.086546 Jul 07 04:11:36.702305 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 566/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:36 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:37.718899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:37.719811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:37.726610 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:37.727071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:37.727858 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:37.728590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:37.874405 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:37.881885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-614278ac-5663-4963-b1d2-98f217662a96 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1277 microversion: 2.1 time: 0.167310 Jul 07 04:11:37.882465 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 535/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:37 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:38.362697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-468524fb-3e22-4d94-9638-736d229031f6 req-8742601b-eec1-414d-8f9b-c3be64aeab11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:11:38.380113 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-468524fb-3e22-4d94-9638-736d229031f6 req-8742601b-eec1-414d-8f9b-c3be64aeab11 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:38.380529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-468524fb-3e22-4d94-9638-736d229031f6 req-8742601b-eec1-414d-8f9b-c3be64aeab11 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:38.397275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-468524fb-3e22-4d94-9638-736d229031f6 req-8742601b-eec1-414d-8f9b-c3be64aeab11 service nova] Creating event network-changed:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:11:38.402205 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-468524fb-3e22-4d94-9638-736d229031f6 req-8742601b-eec1-414d-8f9b-c3be64aeab11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043073 Jul 07 04:11:38.403550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 567/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:11:38.899015 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:38.899619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:38.906744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:38.907189 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:38.907952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:38.908418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:39.042899 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:39.051409 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e8bb1a03-68b1-412e-bd73-3dd222cebd88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1277 microversion: 2.1 time: 0.156239 Jul 07 04:11:39.051986 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 536/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:38 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:40.069385 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:40.070087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:40.076703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:40.077159 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:40.077908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:40.078337 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:40.214178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:40.222811 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6c94cc3a-95f9-4959-8ce0-bb0a17d0f824 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1277 microversion: 2.1 time: 0.158245 Jul 07 04:11:40.223379 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 568/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:40 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:41.238793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:41.239407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:41.245844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:41.246871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:41.247622 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:41.248053 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:41.376557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:41.383876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0db3fb3e-0c5f-417d-861d-39fc285a05f6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1277 microversion: 2.1 time: 0.148968 Jul 07 04:11:41.384470 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 537/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:41 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:42.401109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:42.401722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:42.404665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:42.411332 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:42.411754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:42.412538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:42.412973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:42.546683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:42.554172 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-65614cd6-4971-4cd3-ab9d-123a8cc40eab tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1277 microversion: 2.1 time: 0.156977 Jul 07 04:11:42.554734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 569/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:42 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:43.571811 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:43.572544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:43.574540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:43.575853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:43.582421 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:43.582870 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:43.583634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:43.584069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:43.729270 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:43.737571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e86215fd-1fe2-4f06-bbba-9654041a909f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.169898 Jul 07 04:11:43.738271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 538/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:43 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:44.756599 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:44.757145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:44.765484 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:44.765942 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:44.766704 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:44.767139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:44.900185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:44.907677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c6d613cb-00da-456b-a454-ae1be2428f7f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.155107 Jul 07 04:11:44.908245 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 570/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:44 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:45.924947 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:45.926481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:45.933479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:45.934101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:45.935563 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:45.936227 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:46.073010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:46.080543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b9f49202-3d71-4c21-9524-c2496854c1b6 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.159599 Jul 07 04:11:46.081119 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 539/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:45 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:47.097626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:47.098237 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:47.104948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:47.105388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:47.106138 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:47.107383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:47.234714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:47.242208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e007add-2899-44e3-99ed-81c8c54fff8a tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.148327 Jul 07 04:11:47.242718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 571/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:47 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:48.258135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:48.258750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:48.265734 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:48.266177 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:48.266929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:48.267360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:48.402706 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:48.410767 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-381140f8-b9ef-47c1-859c-2c4c2c107212 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.156469 Jul 07 04:11:48.411332 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 540/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:48 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:49.428447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:49.429085 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:49.436104 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:49.436579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:49.437347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:49.437783 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:49.566927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:49.574293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c72bd15e-b800-4995-b6c4-ff42679eaa43 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.149745 Jul 07 04:11:49.574861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 572/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:49 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:50.591440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:50.592048 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:50.598485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:50.598929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:50.599681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:50.600112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:50.732750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:50.740246 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ddd9c4c6-7517-4ab1-ad09-5068b8237ecf tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.152696 Jul 07 04:11:50.740830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 541/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:50 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:51.757432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:51.758039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:51.764560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:51.765005 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:51.765757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:51.766188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:51.893943 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:51.901291 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-162745f4-49c9-40fa-83e1-fb01786cd9f5 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.147852 Jul 07 04:11:51.901853 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 573/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:51 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:52.918224 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:52.919877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:52.925982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:52.926430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:52.927218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:52.927654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:53.063073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:53.070636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6b260f3e-ca74-4393-bb44-a73b5d0e509f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.156219 Jul 07 04:11:53.071426 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 542/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:52 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:54.087295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:54.087911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:54.094682 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:54.095128 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:54.095887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:54.096340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:54.228715 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:54.237129 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b00043ab-910f-4f2c-b6eb-2ad6b7cf9cda tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.153674 Jul 07 04:11:54.237695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 574/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:54 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:55.254118 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:55.254667 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:55.260739 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:55.261190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:55.261948 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:55.262438 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:55.398191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:55.406280 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b0633735-7a4a-4c58-ba0c-5614f1fc379e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.156212 Jul 07 04:11:55.406844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 543/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:55 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:56.423531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:56.424067 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:56.430258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:56.430708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:56.431459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:56.431898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:56.567340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:56.574775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16a51512-6382-4306-b7e4-787e90df289d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.155807 Jul 07 04:11:56.575849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 575/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:56 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:57.592742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:57.593359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:57.599888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:57.600361 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:57.601116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:57.601546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:57.728058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:57.736916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-43357727-092e-4dfd-bbf2-a89d4962682d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.148708 Jul 07 04:11:57.737482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 544/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:57 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:58.447134 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-1147d1d6-899f-47c2-8369-fa07faa1bc2f req-bc1e0460-a238-46b9-871e-ef426e619f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "name": "network-vif-plugged", "status": "completed", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:11:58.462768 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-1147d1d6-899f-47c2-8369-fa07faa1bc2f req-bc1e0460-a238-46b9-871e-ef426e619f1f service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:58.463210 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-1147d1d6-899f-47c2-8369-fa07faa1bc2f req-bc1e0460-a238-46b9-871e-ef426e619f1f service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:58.476888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-1147d1d6-899f-47c2-8369-fa07faa1bc2f req-bc1e0460-a238-46b9-871e-ef426e619f1f service nova] Creating event network-vif-plugged:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:11:58.482671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-1147d1d6-899f-47c2-8369-fa07faa1bc2f req-bc1e0460-a238-46b9-871e-ef426e619f1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040828 Jul 07 04:11:58.483590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 576/1120] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:11:58.754669 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:58.755346 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:58.761580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:58.762264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:58.763560 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:58.763992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:58.907649 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:11:58.912638 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-667c5419-e6fa-4daa-9054-4facd42eb560 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.162370 Jul 07 04:11:58.913203 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 545/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:58 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:11:59.931375 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:11:59.932173 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:11:59.938912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:59.939462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:11:59.940472 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:11:59.941105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:00.078311 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:00.085719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fe60d182-2f73-4c9a-9e3a-4300ddad3c47 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.159279 Jul 07 04:12:00.086281 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 577/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:11:59 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:01.103073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:01.103994 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:01.111018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:01.111469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:01.112226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:01.112688 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:01.245377 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:01.253723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3a451285-8867-4079-a071-ff1689b07bf0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.154540 Jul 07 04:12:01.254296 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 546/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:01 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:02.271348 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:02.271895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:02.274274 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=31 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:02.279748 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:02.280201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:02.281007 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:02.281540 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:02.286679 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=71 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:02.422053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:02.429764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-818e8ca8-d21c-437f-8d59-518e5107424d tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1265 microversion: 2.1 time: 0.162569 Jul 07 04:12:02.430339 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 578/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:02 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:03.446631 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:03.447578 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:03.450363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:03.455823 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:03.456305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:03.457071 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:03.457535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:03.460820 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=87 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:03.591436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:03.598980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a089e743-340b-45b4-a8ac-67734c4ab934 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1452 microversion: 2.1 time: 0.156266 Jul 07 04:12:03.599567 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 547/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:03 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:03.615396 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:03.616018 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:03.622442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:03.622894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:03.624236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:03.624695 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:03.752559 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:03.760052 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b6d3e4ed-d990-44fe-adc2-f84c6f067be3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1452 microversion: 2.1 time: 0.148575 Jul 07 04:12:03.760673 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 579/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:03 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:05.714650 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-01240902-fe83-4949-9034-587f5e3906c2 req-8dea5a12-52a3-4d6c-987d-a92fa15c18cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:12:05.724056 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-01240902-fe83-4949-9034-587f5e3906c2 req-8dea5a12-52a3-4d6c-987d-a92fa15c18cf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:05.724549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-01240902-fe83-4949-9034-587f5e3906c2 req-8dea5a12-52a3-4d6c-987d-a92fa15c18cf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:05.745115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-01240902-fe83-4949-9034-587f5e3906c2 req-8dea5a12-52a3-4d6c-987d-a92fa15c18cf service nova] Creating event network-changed:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:12:05.751682 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-01240902-fe83-4949-9034-587f5e3906c2 req-8dea5a12-52a3-4d6c-987d-a92fa15c18cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040397 Jul 07 04:12:05.752362 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 548/1127] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:12:53.390427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:53.391338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:53.394014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:53.394649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=11 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:53.400106 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.400569 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.401322 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.401757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.430211 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a209a85f-2b65-40e2-b465-ba201db8f6b7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043813 Jul 07 04:12:53.430754 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 580/1128] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jul 7 04:12:53 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:53.485871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:53.486665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=7 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:53.491058 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:53.491646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:53.498495 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.498945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.499705 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.500143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.524657 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:12:53.598196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-161663ff-0967-483b-b634-a8c0f249d199 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 204 len: 0 microversion: 2.20 time: 0.113730 Jul 07 04:12:53.599028 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 549/1129] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jul 7 04:12:53 2022] DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 04:12:53.609465 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:53.610074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:53.616178 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.616663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.617440 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:53.617871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:53.750275 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:53.758638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:53.760145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:53.761335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9689e7e0-a9d2-4271-bb3c-f552eaeef43d tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.157087 Jul 07 04:12:53.761899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 581/1130] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:12:53 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:12:54.784341 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:54.784968 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:54.791135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:54.791579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:54.792375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:54.792815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:54.920245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:54.928768 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:54.930271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:54.931458 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fc6d583c-f998-4e3a-8034-895a785c033c tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.152100 Jul 07 04:12:54.932019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 550/1131] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:12:54 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 04:12:55.950546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:55.951206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:55.957238 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:55.957683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:55.958438 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:55.958870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:56.092986 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:56.101156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:56.102881 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5219f613f5b43d6978f2fe410ce4d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43d47ba220e4705adeb85c31c6605e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:56.104033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bb8166e1-21b3-4ef4-904d-184209079031 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 200 len: 1723 microversion: 2.20 time: 0.157585 Jul 07 04:12:56.104922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 582/1132] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:12:55 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 04:12:56.483472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-dabcfcbd-46e8-4f18-804f-c0a9926d730b req-e35a4668-cda4-45e9-82a0-b9fef1f406ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6", "name": "network-vif-deleted", "tag": "2c6d476f-429d-4ee6-9646-ba4d87d0e81d"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:12:56.492773 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-dabcfcbd-46e8-4f18-804f-c0a9926d730b req-e35a4668-cda4-45e9-82a0-b9fef1f406ed service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:56.493213 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-dabcfcbd-46e8-4f18-804f-c0a9926d730b req-e35a4668-cda4-45e9-82a0-b9fef1f406ed service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:56.504859 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-dabcfcbd-46e8-4f18-804f-c0a9926d730b req-e35a4668-cda4-45e9-82a0-b9fef1f406ed service nova] Creating event network-vif-deleted:2c6d476f-429d-4ee6-9646-ba4d87d0e81d for instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 on hv-cinder-84684 Jul 07 04:12:56.510616 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-dabcfcbd-46e8-4f18-804f-c0a9926d730b req-e35a4668-cda4-45e9-82a0-b9fef1f406ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Jul 07 04:12:56.511799 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 551/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:12:57.122887 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:57.123505 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:57.131249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.131708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.132521 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.132964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.150709 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 HTTP/1.1 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:12:57.152423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:57.154079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6'} Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:12:57.154967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:57.157090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.158772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:12:57.158772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-218d9752-4a12-4b68-a2f4-65f9a5566311 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 404 len: 111 microversion: 2.20 time: 0.034820 Jul 07 04:12:57.158772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 583/1134] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:12:57 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:12:57.163781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-286c6ece-a63f-4145-9756-ff32cad15cff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '.version_select at 0x7ff65560baf0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:57.169855 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR oslo.messaging._drivers.impl_rabbit [None req-286c6ece-a63f-4145-9756-ff32cad15cff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [52560027-9b3f-4726-bf9e-88488fc56aeb] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 04:12:57.591264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:57.591767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:57.598372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.598821 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.599583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.600022 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.623355 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7349fd64-b875-4d6c-95d0-b11dbcc1bcf4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/ips" status: 200 len: 150 microversion: 2.1 time: 0.229728 Jul 07 04:12:57.623899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 584/1135] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:12:57 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/ips => generated 150 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:12:57.634380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb31b054-b00a-4684-b95b-8bc7bffbd94c"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:12:57.635479 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:57.641156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.641607 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.643025 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.643482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.719871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/os-volume_attachments HTTP/1.1 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 74 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:12:57.721681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {"volumeAttachment": {"volumeId": "cb31b054-b00a-4684-b95b-8bc7bffbd94c"}} Jul 07 04:12:57.723330 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'server_id': 'e76e2aeb-a40d-49ce-81b1-3248e45c25f2', 'body': {'volumeAttachment': {'volumeId': 'cb31b054-b00a-4684-b95b-8bc7bffbd94c'}}} Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.725716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:57.727277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 400 to user: Invalid volume: volume cb31b054-b00a-4684-b95b-8bc7bffbd94c is already attached to instances: 52aceba7-9cb8-4018-b6d9-564135ba117a {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d34c6f72-32dd-4969-b43f-beda65e028b6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092340 Jul 07 04:12:57.728847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 585/1136] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:12:57 2022] POST /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 04:12:57.733093 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:57.733591 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:57.739415 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.739872 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.740663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.741105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.766726 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:12:57.840126 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e41ecdca-3517-4e65-8e99-88640411a5fe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 204 len: 0 microversion: 2.1 time: 0.110519 Jul 07 04:12:57.840736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 586/1137] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:12:57 2022] DELETE /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 04:12:57.849658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:57.850356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:57.856483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.856926 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.857683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:57.858112 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:57.993939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:58.001405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-60e667a1-c575-4f5c-bf39-ec31c29f2b2b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1682 microversion: 2.1 time: 0.156198 Jul 07 04:12:58.003173 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 587/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:57 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:12:58.175265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [None req-286c6ece-a63f-4145-9756-ff32cad15cff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [52560027-9b3f-4726-bf9e-88488fc56aeb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57588. Jul 07 04:12:58.193212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-286c6ece-a63f-4145-9756-ff32cad15cff tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067589551" status: 204 len: 0 microversion: 2.20 time: 1.033892 Jul 07 04:12:58.194238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 552/1139] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Jul 7 04:12:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067589551 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 04:12:59.020506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:59.021118 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:59.027490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:59.027937 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:59.028711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:59.029142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:59.165298 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:12:59.172640 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9285c730-84d6-41f6-becb-0fed6a956fb5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1682 microversion: 2.1 time: 0.156578 Jul 07 04:12:59.173207 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 588/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:12:59 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:12:59.959911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:59.960602 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:12:59.967601 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:59.968046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:59.969009 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:12:59.969450 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:12:59.983232 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 HTTP/1.1 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:12:59.984973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:59.986486 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6'} Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:12:59.987266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:12:59.988544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:12:59.989832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:12:59.989832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fb05a47f-3aeb-41e6-a16f-1b5a541f8d88 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 404 len: 111 microversion: 2.20 time: 0.031595 Jul 07 04:12:59.989832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 553/1141] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jul 7 04:12:59 2022] DELETE /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:12:59.998194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:12:59.998808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:00.005436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:00.005884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:00.006649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:00.007083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:00.021485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 HTTP/1.1 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:13:00.023142 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:13:00.024889 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6'} Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:13:00.025802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. Jul 07 04:13:00.027061 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:00.028541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:13:00.028541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-452e7a1b-0d39-4c1a-add9-d90b3bdd48fb tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6" status: 404 len: 111 microversion: 2.20 time: 0.030357 Jul 07 04:13:00.028541 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 589/1142] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:12:59 2022] GET /compute/v2.1/servers/bd1915d5-a7bb-4c7d-b5a3-4fa51d2c1fa6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:13:00.190440 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:00.191212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:00.197299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:00.197827 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:00.198675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:00.199185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:00.333677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:00.341442 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-93db4d48-e8f4-405d-837e-4b2e24deee2f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 200 len: 1682 microversion: 2.1 time: 0.154971 Jul 07 04:13:00.353363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 554/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:00 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:00.748372 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-0686fa97-6d66-4503-9766-038409bcb0dd req-fc13371a-e40d-4b7e-a744-8288d3bdfc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76e2aeb-a40d-49ce-81b1-3248e45c25f2", "name": "network-vif-deleted", "tag": "2de171c4-6bac-4d53-a9e6-9a18419d949f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:00.759893 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0686fa97-6d66-4503-9766-038409bcb0dd req-fc13371a-e40d-4b7e-a744-8288d3bdfc54 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:00.760508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0686fa97-6d66-4503-9766-038409bcb0dd req-fc13371a-e40d-4b7e-a744-8288d3bdfc54 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:00.774276 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-0686fa97-6d66-4503-9766-038409bcb0dd req-fc13371a-e40d-4b7e-a744-8288d3bdfc54 service nova] Creating event network-vif-deleted:2de171c4-6bac-4d53-a9e6-9a18419d949f for instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 on hv-cinder-84684 Jul 07 04:13:00.780362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-0686fa97-6d66-4503-9766-038409bcb0dd req-fc13371a-e40d-4b7e-a744-8288d3bdfc54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Jul 07 04:13:00.781357 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 590/1144] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:01.163483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:01.164395 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:01.172222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.173298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.174796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.175370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.191099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 HTTP/1.1 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:13:01.192898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.194600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '7fa9f4c3-0b0f-4e41-84da-1db40ece44b4'} Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:13:01.195460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.196796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.198052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:13:01.198052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9d0d791d-ee7a-4fcf-8848-ea871375c5d7 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 404 len: 111 microversion: 2.20 time: 0.034729 Jul 07 04:13:01.198052 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 555/1145] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jul 7 04:13:01 2022] DELETE /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:13:01.203712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:01.204443 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] [instance: 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:01.210806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.211253 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.212076 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.212555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.228716 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] HTTP exception thrown: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Request method failure captured: Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 HTTP/1.1 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlnma6OKHwjtnGIgEkyG2h6BBbFiKIsKZAXHN_VMrxSkNPFqMG_6NwHLl4FWRB_nnKXaTPkXvV_d7Q4BYNlMtUjB0P2KKdgXfQNIJtrPrltWP42J1LGXaldwuwOU0luA1WKGJckf988K-spnyhl27bJgCCZELLiytg64TLp8yVY0Css Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:13:01.230710 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43d47ba220e4705adeb85c31c6605e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: a43d47ba220e4705adeb85c31c6605e1 Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-238047353 Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: a5219f613f5b43d6978f2fe410ce4d4f Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-238047353-project Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.232216 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '7fa9f4c3-0b0f-4e41-84da-1db40ece44b4'} Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:13:01.233029 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. Jul 07 04:13:01.234256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.235555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] Returning 404 to user: Instance 7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:13:01.235555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6f2a4fb1-1c7e-411c-a44c-489bd4c7f151 tempest-AttachVolumeShelveTestJSON-238047353 tempest-AttachVolumeShelveTestJSON-238047353-project] 10.222.0.20 "GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4" status: 404 len: 111 microversion: 2.20 time: 0.032665 Jul 07 04:13:01.235555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 591/1146] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jul 7 04:13:01 2022] GET /compute/v2.1/servers/7fa9f4c3-0b0f-4e41-84da-1db40ece44b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:13:01.362101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:01.362894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:01.369148 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.369598 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.370370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:01.370801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:01.385282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 HTTP/1.1 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:13:01.386826 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:13:01.388233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'e76e2aeb-a40d-49ce-81b1-3248e45c25f2'} Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:13:01.389144 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:13:01.390407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:01.391553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:13:01.391553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-214d01e3-0981-48fa-b2be-0cdc7d594f57 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 404 len: 111 microversion: 2.1 time: 0.030895 Jul 07 04:13:01.391553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 556/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:01 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:13:01.399181 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c666261-fcc2-4957-8266-6a26bf3776a4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '.version_select at 0x7ff655751670>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:01.423155 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c666261-fcc2-4957-8266-6a26bf3776a4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585101811" status: 202 len: 0 microversion: 2.1 time: 0.028032 Jul 07 04:13:01.423767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 592/1148] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Jul 7 04:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585101811 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:13:02.153162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:02.153663 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:02.160160 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:02.160643 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:02.161409 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:02.161849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:02.245122 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lazy-loading 'services' on Instance uuid 52aceba7-9cb8-4018-b6d9-564135ba117a {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:13:02.320391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-16795902-3342-41f9-a76f-b595030d97e2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments/cb31b054-b00a-4684-b95b-8bc7bffbd94c" status: 202 len: 0 microversion: 2.1 time: 0.170944 Jul 07 04:13:02.321895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 557/1149] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:13:02 2022] DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments/cb31b054-b00a-4684-b95b-8bc7bffbd94c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:13:02.329471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:02.330796 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:02.338749 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:02.339438 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:02.340482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:02.340995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:02.383849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2b16286a-5325-49a6-a152-435314e966c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058219 Jul 07 04:13:02.385105 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 593/1150] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:13:02 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:03.397298 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:03.398391 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:03.406958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.407427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.408904 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.409347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.438871 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2f3edf2e-ae27-414b-8ed5-4d65852632ce tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047496 Jul 07 04:13:03.440083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 558/1151] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:13:03 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:13:03.503303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:03.503848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:03.510310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.510765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.511531 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.511972 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.538445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:13:03.626421 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1ffb4db7-5d14-4cb4-8e43-efc7a27018be tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 204 len: 0 microversion: 2.1 time: 0.127712 Jul 07 04:13:03.627008 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 594/1152] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:13:03 2022] DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:13:03.635410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:03.636127 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:03.642693 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.643154 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.643936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:03.644411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:03.800893 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:03.808358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-641867d0-a8ae-4b57-8cae-58499d5fea85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1681 microversion: 2.1 time: 0.176792 Jul 07 04:13:03.808926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 559/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:03 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:04.826955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:04.827788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:04.834765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:04.835217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:04.835995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:04.836457 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:04.977410 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:04.985460 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c5d4cc1-cae6-4d90-a95a-212b2e93f82b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1681 microversion: 2.1 time: 0.163038 Jul 07 04:13:04.986107 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 595/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:04 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:05.903557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-57afe729-66a7-4610-b715-09778ad9b801 req-02db233f-cb00-47f4-9eb8-8664fbae42a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aceba7-9cb8-4018-b6d9-564135ba117a", "name": "network-vif-deleted", "tag": "b6e75047-28ef-4468-8652-151481ddb11a"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:05.922641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-57afe729-66a7-4610-b715-09778ad9b801 req-02db233f-cb00-47f4-9eb8-8664fbae42a5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:05.923105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-57afe729-66a7-4610-b715-09778ad9b801 req-02db233f-cb00-47f4-9eb8-8664fbae42a5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:05.935627 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-57afe729-66a7-4610-b715-09778ad9b801 req-02db233f-cb00-47f4-9eb8-8664fbae42a5 service nova] Creating event network-vif-deleted:b6e75047-28ef-4468-8652-151481ddb11a for instance 52aceba7-9cb8-4018-b6d9-564135ba117a on hv-cinder-84684 Jul 07 04:13:05.945005 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-57afe729-66a7-4610-b715-09778ad9b801 req-02db233f-cb00-47f4-9eb8-8664fbae42a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045640 Jul 07 04:13:05.945936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 560/1155] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:06.006268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:06.007660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:06.016217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:06.016720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:06.017772 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:06.018824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:06.111900 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:06.123483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18e79cd3-9dc2-4246-ac1d-f21b051462da tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 200 len: 1325 microversion: 2.1 time: 0.124168 Jul 07 04:13:06.124733 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 596/1156] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:05 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 1325 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:07.142844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:07.143575 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:07.149867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:07.150317 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:07.151069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:07.151503 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:07.164740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a HTTP/1.1 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:13:07.166389 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:13:07.168003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '52aceba7-9cb8-4018-b6d9-564135ba117a'} Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:13:07.169135 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:13:07.170619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:13:07.172634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:13:07.172634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3267f25c-e316-4411-84b6-928a2d87c9f6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 404 len: 111 microversion: 2.1 time: 0.029602 Jul 07 04:13:07.172634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 561/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:07 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:13:07.177152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b5dc374d-09b4-4df5-8ce6-6313aaee4063 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '.version_select at 0x7ff655736430>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:07.194212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b5dc374d-09b4-4df5-8ce6-6313aaee4063 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59331380" status: 202 len: 0 microversion: 2.1 time: 0.021527 Jul 07 04:13:07.194762 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 597/1158] 10.222.0.20 () {58 vars in 1214 bytes} [Thu Jul 7 04:13:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59331380 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:13:07.804815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d5e5c45e-5e1d-460a-b2a6-60a534bdee5f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: .version_select at 0x7ff6556fb310>, body: {"keypair": {"name": "tempest-keypair-918060103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1ri7i5IUhbNKWlomHiVYQRUhKNlQVNkNcc8IYmscGMmjAM2XXG+4gSW1+3ll25epPLNRn2fyQ9ghBYEnzL+929E+Ciai1oGcsY1zRFJYtLtAvg4ciMz7xQRb1PVB/8xw=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:07.820261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-d5e5c45e-5e1d-460a-b2a6-60a534bdee5f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:13:07.824034 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-d5e5c45e-5e1d-460a-b2a6-60a534bdee5f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:13:07.845830 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d5e5c45e-5e1d-460a-b2a6-60a534bdee5f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044672 Jul 07 04:13:07.846544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 562/1159] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:13:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:09.131398 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1462957582", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb43ae82-16c6-4173-a04e-f756cd39db29"}], "security_groups": [{"name": "tempest-securitygroup--2063102327"}], "key_name": "tempest-keypair-918060103", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:09.233751 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] validate_networks() for [('eb43ae82-16c6-4173-a04e-f756cd39db29', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:13:09.991867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:13:09.992301 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:13:09.992792 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:13:09.993199 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:13:09.993609 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:13:10.002865 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:10.003306 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:10.004090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:10.004548 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:10.011301 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:10.024697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:13:10.028630 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:13:10.039486 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:13:10.041757 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:13:10.084826 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [90e79231-d26f-46ec-8db1-b8bb7c28cdc1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 04:13:11.092570 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [90e79231-d26f-46ec-8db1-b8bb7c28cdc1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57796. Jul 07 04:13:11.097231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d930daa2-3def-449e-af8d-5fc968cd7000 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.970798 Jul 07 04:13:11.097908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 598/1160] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:13:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:13:11.107992 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-590d944d-5bdc-46c8-b900-f1b8bb7a9e59 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:11.108646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-590d944d-5bdc-46c8-b900-f1b8bb7a9e59 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:11.163942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-590d944d-5bdc-46c8-b900-f1b8bb7a9e59 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:11.170647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-590d944d-5bdc-46c8-b900-f1b8bb7a9e59 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1241 microversion: 2.1 time: 0.066717 Jul 07 04:13:11.171379 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 563/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:11 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:12.187212 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8e0b858c-f2b7-4c51-a077-216c590513d5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:12.187838 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8e0b858c-f2b7-4c51-a077-216c590513d5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:12.244791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8e0b858c-f2b7-4c51-a077-216c590513d5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:12.251378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8e0b858c-f2b7-4c51-a077-216c590513d5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1241 microversion: 2.1 time: 0.068511 Jul 07 04:13:12.252769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 599/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:12 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:13.267796 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8587dead-2e34-41c4-b38e-7cc1031a306e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:13.268444 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8587dead-2e34-41c4-b38e-7cc1031a306e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:13.324885 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8587dead-2e34-41c4-b38e-7cc1031a306e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:13.331737 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8587dead-2e34-41c4-b38e-7cc1031a306e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1241 microversion: 2.1 time: 0.067687 Jul 07 04:13:13.332313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 564/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:13 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:14.349704 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-67ffda7c-e65e-48f4-ad77-2b874bd6ac56 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:14.350431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-67ffda7c-e65e-48f4-ad77-2b874bd6ac56 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:14.407902 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-67ffda7c-e65e-48f4-ad77-2b874bd6ac56 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:14.415369 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-67ffda7c-e65e-48f4-ad77-2b874bd6ac56 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1241 microversion: 2.1 time: 0.070251 Jul 07 04:13:14.415955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 600/1164] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:14 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:15.432805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:15.433350 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:15.441201 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:15.441646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:15.442576 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:15.443010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:15.506504 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:15.514021 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f4f0784-5aff-4979-a927-3f8695502c4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1245 microversion: 2.1 time: 0.085172 Jul 07 04:13:15.514590 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 565/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:15 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:16.532289 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:16.533080 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:16.540290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:16.540873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:16.541713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:16.542356 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:16.609759 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:16.621988 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c82bb527-21dd-4e94-ae84-1c207c7997c8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1299 microversion: 2.1 time: 0.093899 Jul 07 04:13:16.622576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 601/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:16 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:17.589779 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-a253b462-50f3-4ac1-a5ef-464a47c2a6fc req-d47850ed-19b5-4e7d-a97c-47e6324aa84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95850d83-f1a7-4262-8c08-8325c1338d59", "tag": "a1c0c04a-4a51-45a0-a789-60c406c4aab5"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:17.600894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-a253b462-50f3-4ac1-a5ef-464a47c2a6fc req-d47850ed-19b5-4e7d-a97c-47e6324aa84a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:17.601344 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-a253b462-50f3-4ac1-a5ef-464a47c2a6fc req-d47850ed-19b5-4e7d-a97c-47e6324aa84a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:17.614399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-a253b462-50f3-4ac1-a5ef-464a47c2a6fc req-d47850ed-19b5-4e7d-a97c-47e6324aa84a service nova] Creating event network-changed:a1c0c04a-4a51-45a0-a789-60c406c4aab5 for instance 95850d83-f1a7-4262-8c08-8325c1338d59 on hv-cinder-84684 Jul 07 04:13:17.623241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-a253b462-50f3-4ac1-a5ef-464a47c2a6fc req-d47850ed-19b5-4e7d-a97c-47e6324aa84a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044307 Jul 07 04:13:17.624164 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 566/1167] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:17.639177 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:17.639806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:17.648144 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:17.648618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:17.649639 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:17.650077 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:17.808896 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:17.817208 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-069f05f8-02c3-4a6d-b3f7-c67385a4b478 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.182026 Jul 07 04:13:17.817788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 602/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:17 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:18.835310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:18.836059 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:18.842278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:18.842735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:18.843500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:18.843942 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:18.976624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:18.984442 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-fa5d8ad3-e0df-4dcc-aa45-eaea28771223 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.153926 Jul 07 04:13:18.985011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 567/1169] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:18 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:20.000405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:20.001020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:20.007840 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:20.008313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:20.009073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:20.009509 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:20.013401 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:20.371828 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:20.379966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5dc05dc6-39e6-473a-8fb1-da4c5c641b49 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.383335 Jul 07 04:13:20.380586 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 603/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:19 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:13:21.397104 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:21.397806 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:21.404150 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:21.404692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:21.408339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:21.408339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:21.800242 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:21.809413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cb881057-24c4-4711-a119-898b88fd22ef tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.415770 Jul 07 04:13:21.810007 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 568/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:21 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:22.826784 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:22.827400 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:22.834417 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:22.834871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:22.835625 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:22.836057 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:22.964827 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:22.972037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-256e6f18-a899-44f8-9199-c2452d1bc66a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.149282 Jul 07 04:13:22.972636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 604/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:22 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:23.989816 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:23.990427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:23.992829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=8 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:23.993475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:23.998866 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:23.999308 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:24.000061 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:24.000513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:24.005205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:24.135867 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:24.143656 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f0e765b-2719-45dc-86c6-db2b8c5adb5a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.157916 Jul 07 04:13:24.144221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 569/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:23 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:24.807883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-0091e67c-1180-4b4f-a86e-bb1a35816745 req-6bbe947f-7ef2-49cf-9032-605cb7467f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95850d83-f1a7-4262-8c08-8325c1338d59", "name": "network-vif-plugged", "status": "completed", "tag": "a1c0c04a-4a51-45a0-a789-60c406c4aab5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:24.812608 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=10 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:24.813261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:24.818652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0091e67c-1180-4b4f-a86e-bb1a35816745 req-6bbe947f-7ef2-49cf-9032-605cb7467f3a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:24.819118 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-0091e67c-1180-4b4f-a86e-bb1a35816745 req-6bbe947f-7ef2-49cf-9032-605cb7467f3a service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:24.841198 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-0091e67c-1180-4b4f-a86e-bb1a35816745 req-6bbe947f-7ef2-49cf-9032-605cb7467f3a service nova] Creating event network-vif-plugged:a1c0c04a-4a51-45a0-a789-60c406c4aab5 for instance 95850d83-f1a7-4262-8c08-8325c1338d59 on hv-cinder-84684 Jul 07 04:13:24.846378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-0091e67c-1180-4b4f-a86e-bb1a35816745 req-6bbe947f-7ef2-49cf-9032-605cb7467f3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042212 Jul 07 04:13:24.858269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 605/1174] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:25.161036 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:25.161641 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:25.167724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:25.168105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:25.168905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:25.169339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:25.306907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:25.314460 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-61668a46-d6fe-4714-b28b-47452eb2fd63 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.157801 Jul 07 04:13:25.315662 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 570/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:25 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:26.332727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:26.333452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:26.341413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:26.341863 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:26.342651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:26.343248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:26.493234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:26.501019 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d1799247-4ce1-4841-8fb6-c3ab59021e35 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1367 microversion: 2.1 time: 0.173054 Jul 07 04:13:26.501848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 606/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:26 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:27.518621 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:27.519283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:27.525805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:27.526260 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:27.527031 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:27.527466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:27.657525 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:13:27.665637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-50ad9832-b26c-4913-895c-cccd1aa4fec8 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1558 microversion: 2.1 time: 0.151279 Jul 07 04:13:27.666339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 571/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:13:27 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:13:27.683661 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:13:27.684196 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:13:27.690703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:27.691249 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:27.692016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:27.692490 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:27.774014 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ccacbf58-7b84-4988-bc16-41ac50156eb2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094189 Jul 07 04:13:27.774723 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 607/1178] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:13:27 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:13:28.756263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-d66af965-ebbf-4928-8210-46987065f577 req-ee60379c-9322-409e-ac75-26c8eb70f3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95850d83-f1a7-4262-8c08-8325c1338d59", "tag": "a1c0c04a-4a51-45a0-a789-60c406c4aab5"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:13:28.766977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d66af965-ebbf-4928-8210-46987065f577 req-ee60379c-9322-409e-ac75-26c8eb70f3f0 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:13:28.767472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-d66af965-ebbf-4928-8210-46987065f577 req-ee60379c-9322-409e-ac75-26c8eb70f3f0 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:13:28.782766 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-d66af965-ebbf-4928-8210-46987065f577 req-ee60379c-9322-409e-ac75-26c8eb70f3f0 service nova] Creating event network-changed:a1c0c04a-4a51-45a0-a789-60c406c4aab5 for instance 95850d83-f1a7-4262-8c08-8325c1338d59 on hv-cinder-84684 Jul 07 04:13:28.789312 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-d66af965-ebbf-4928-8210-46987065f577 req-ee60379c-9322-409e-ac75-26c8eb70f3f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038193 Jul 07 04:13:28.790126 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 572/1179] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:14:18.538250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=5 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:18.539683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=36 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:18.543815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-468107420", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:18.593800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] validate_networks() for None {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:14:18.860856 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:14:18.861295 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:14:18.861764 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:14:18.862203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:14:18.862611 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:14:18.872191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:18.872727 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:18.873442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:18.873871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:18.890562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Getting quotas for project f5aa03e4808244d6b6488ef9ab7208f3. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:14:18.894676 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Getting quotas for user 527c25b9a9474134b5922e78e78e2abd and project f5aa03e4808244d6b6488ef9ab7208f3. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:14:18.907832 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:14:18.910102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:14:18.953458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-717ee297-a1e7-455c-9031-2bfa3d541e1f tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.416776 Jul 07 04:14:18.954088 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 608/1180] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:14:18.962571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=7 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:18.963320 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=19 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:18.967949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ddefbdd1-915c-4554-bd14-2e2b10361124 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:18.968905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ddefbdd1-915c-4554-bd14-2e2b10361124 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:19.027353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ddefbdd1-915c-4554-bd14-2e2b10361124 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:19.034691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ddefbdd1-915c-4554-bd14-2e2b10361124 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1214 microversion: 2.1 time: 0.074403 Jul 07 04:14:19.035612 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 573/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:18 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:20.052577 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:20.053235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:20.059411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:20.059849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:20.060810 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:20.061325 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:20.132185 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:20.140129 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-040913db-ac70-498c-892e-47e583995824 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1272 microversion: 2.1 time: 0.091882 Jul 07 04:14:20.140720 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 609/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:20 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:21.157844 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:21.158584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:21.167002 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:21.168807 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:21.169782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:21.170266 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:21.615633 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:21.623579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-30be7342-17da-4c3d-9234-619b32a06450 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.469623 Jul 07 04:14:21.624130 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 574/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:21 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:21.721300 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-37224d90-9f1f-4b19-852a-75fa2fefa77d req-55a72888-f5bd-4b46-a77e-4869da64d192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6159cf80-a0d8-47f7-8a14-464a33c5a7ac", "tag": "797dcbd7-ce2f-440f-963a-51e5ddc5be05"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:21.754975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-37224d90-9f1f-4b19-852a-75fa2fefa77d req-55a72888-f5bd-4b46-a77e-4869da64d192 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:21.755427 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-37224d90-9f1f-4b19-852a-75fa2fefa77d req-55a72888-f5bd-4b46-a77e-4869da64d192 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:21.767965 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-37224d90-9f1f-4b19-852a-75fa2fefa77d req-55a72888-f5bd-4b46-a77e-4869da64d192 service nova] Creating event network-changed:797dcbd7-ce2f-440f-963a-51e5ddc5be05 for instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac on hv-cinder-84684 Jul 07 04:14:21.773065 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-37224d90-9f1f-4b19-852a-75fa2fefa77d req-55a72888-f5bd-4b46-a77e-4869da64d192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057817 Jul 07 04:14:21.774829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 610/1184] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:14:22.640815 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:22.641431 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:22.647833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:22.648292 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:22.649066 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:22.649500 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:22.775084 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:22.782424 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-41a3d7b0-ed04-4658-af76-b166c9698ccb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.145452 Jul 07 04:14:22.782995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 575/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:22 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:23.801448 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:23.802147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:23.809307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:23.809753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:23.810501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:23.810933 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:23.942533 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:23.949905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4eb5005a-abee-45bd-8ef6-ab493a07055e tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.153329 Jul 07 04:14:23.950471 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 611/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:23 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:24.966967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:24.967559 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:24.973533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:24.973977 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:24.974724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:24.975152 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:25.102958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:25.110549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c2baba3a-5bb3-4863-8da6-c7d412d15d5b tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.147626 Jul 07 04:14:25.111112 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 576/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:24 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:26.126905 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:26.127545 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:26.134338 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:26.134783 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:26.135539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:26.135973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:26.262431 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:26.269786 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d6a6e233-6167-4a9b-8d27-c4fa9c64a6e9 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.146902 Jul 07 04:14:26.270349 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 612/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:26 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:27.286967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:27.287694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:27.294511 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:27.294957 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:27.295712 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:27.296142 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:27.426998 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:27.434546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ffb99db6-73e5-4fa9-ae78-bd5b28be10b1 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.151745 Jul 07 04:14:27.435763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 577/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:27 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:28.451524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:28.452139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:28.458588 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:28.459027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:28.459777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:28.460204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:28.593671 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:28.600955 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e7dbfe97-50be-4eb6-be05-e01bd6d23189 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.153264 Jul 07 04:14:28.602106 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 613/1190] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:28 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:29.112406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-ca9f5a0e-d43b-463d-a0d9-24f2a1968db4 req-dca103c4-7c54-45be-a535-7aac4486f430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6159cf80-a0d8-47f7-8a14-464a33c5a7ac", "name": "network-vif-plugged", "status": "completed", "tag": "797dcbd7-ce2f-440f-963a-51e5ddc5be05"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:29.116434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:29.122538 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-ca9f5a0e-d43b-463d-a0d9-24f2a1968db4 req-dca103c4-7c54-45be-a535-7aac4486f430 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:29.123030 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-ca9f5a0e-d43b-463d-a0d9-24f2a1968db4 req-dca103c4-7c54-45be-a535-7aac4486f430 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:29.135143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-ca9f5a0e-d43b-463d-a0d9-24f2a1968db4 req-dca103c4-7c54-45be-a535-7aac4486f430 service nova] Creating event network-vif-plugged:797dcbd7-ce2f-440f-963a-51e5ddc5be05 for instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac on hv-cinder-84684 Jul 07 04:14:29.140087 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-ca9f5a0e-d43b-463d-a0d9-24f2a1968db4 req-dca103c4-7c54-45be-a535-7aac4486f430 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031528 Jul 07 04:14:29.140723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 578/1191] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:14:29.619266 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:29.619861 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:29.621841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:29.622493 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:29.629200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:29.629643 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:29.630394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:29.630824 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:29.761301 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:29.769309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ffbf099e-d97b-403f-b859-99f17a06f3db tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.154503 Jul 07 04:14:29.769884 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 614/1192] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:29 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:30.787839 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:30.788477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:30.795681 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:30.796418 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:30.797686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:30.798443 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:30.926411 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:30.934724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d156118e-913d-4de1-9a7d-a3916763cc85 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1314 microversion: 2.1 time: 0.151672 Jul 07 04:14:30.935301 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 579/1193] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:30 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:31.951927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:31.952554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:31.959152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:31.959602 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:31.960402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:31.961571 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:32.089842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:32.097191 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b6eb7b4f-394a-4fdb-a7e6-4515e99966b6 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1464 microversion: 2.1 time: 0.149099 Jul 07 04:14:32.097753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 615/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:31 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:32.136057 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:32.136584 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:32.143083 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:32.143527 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:32.144295 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:32.144738 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:32.170792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:14:32.245430 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-87f52a35-72b0-43e3-ba2a-a7b4b35e7f10 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 204 len: 0 microversion: 2.1 time: 0.113581 Jul 07 04:14:32.246189 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 580/1195] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:14:32 2022] DELETE /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:14:32.254270 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:32.254883 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:32.261452 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:32.261899 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:32.262657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:32.263090 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:32.392967 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:32.400383 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-166ad60f-618f-4e4d-9625-e5a6804b5453 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1470 microversion: 2.1 time: 0.150004 Jul 07 04:14:32.400959 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 616/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:32 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:33.418673 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:33.419410 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:33.425772 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:33.426221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:33.426983 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:33.427415 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:33.557546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:33.565084 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4c259ee4-b19a-46cc-89ef-ac905d75ac5c tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1470 microversion: 2.1 time: 0.150708 Jul 07 04:14:33.565661 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 581/1197] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:33 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:34.583436 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:34.584230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:34.595224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.596428 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.597657 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.598368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.700349 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:34.704091 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-88361416-91b3-43cb-8fc5-df9dfea94bb4 req-580d9bc8-bf43-4d47-a113-c08081633608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6159cf80-a0d8-47f7-8a14-464a33c5a7ac", "name": "network-vif-deleted", "tag": "797dcbd7-ce2f-440f-963a-51e5ddc5be05"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:34.723042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ca90fef9-87e5-4369-bd38-97414838cfc7 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1428 microversion: 2.1 time: 0.143701 Jul 07 04:14:34.723991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 617/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:34 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:34.734335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-88361416-91b3-43cb-8fc5-df9dfea94bb4 req-580d9bc8-bf43-4d47-a113-c08081633608 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.734653 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-88361416-91b3-43cb-8fc5-df9dfea94bb4 req-580d9bc8-bf43-4d47-a113-c08081633608 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.749375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-88361416-91b3-43cb-8fc5-df9dfea94bb4 req-580d9bc8-bf43-4d47-a113-c08081633608 service nova] Creating event network-vif-deleted:797dcbd7-ce2f-440f-963a-51e5ddc5be05 for instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac on hv-cinder-84684 Jul 07 04:14:34.755393 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-88361416-91b3-43cb-8fc5-df9dfea94bb4 req-580d9bc8-bf43-4d47-a113-c08081633608 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062798 Jul 07 04:14:34.759226 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 582/1199] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:14:34.912069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-1ce14c5d-3d94-4d11-8374-00f592bc5c6a req-b49cccf5-eaea-4596-b8d9-32bb2280cff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:34.913262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:34.913869 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:34.920388 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.921074 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.921220 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-1ce14c5d-3d94-4d11-8374-00f592bc5c6a req-b49cccf5-eaea-4596-b8d9-32bb2280cff4 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.921762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-1ce14c5d-3d94-4d11-8374-00f592bc5c6a req-b49cccf5-eaea-4596-b8d9-32bb2280cff4 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.922146 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:34.922584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:34.932950 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-1ce14c5d-3d94-4d11-8374-00f592bc5c6a req-b49cccf5-eaea-4596-b8d9-32bb2280cff4 service nova] Creating event network-changed:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:14:34.937917 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-1ce14c5d-3d94-4d11-8374-00f592bc5c6a req-b49cccf5-eaea-4596-b8d9-32bb2280cff4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029865 Jul 07 04:14:34.938783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 583/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:14:34.953529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:14:35.030585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-48dcfbef-257a-4bda-a1d7-0a391bb822dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 204 len: 0 microversion: 2.1 time: 0.124931 Jul 07 04:14:35.031188 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 618/1201] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:14:34 2022] DELETE /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:14:35.040675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:35.041378 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:35.048222 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:35.048750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:35.049528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:35.049966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:35.200283 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:35.208817 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-95e84988-2b81-4e1d-b670-3bf8eaab5d80 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.172545 Jul 07 04:14:35.209567 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 584/1202] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:35 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:35.742268 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:35.742978 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:35.749682 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:35.750130 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:35.750898 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:35.751329 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:35.785628 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:35.786347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:35.786797 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lazy-loading 'fault' on Instance uuid 6159cf80-a0d8-47f7-8a14-464a33c5a7ac {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:14:35.832154 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527c25b9a9474134b5922e78e78e2abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5aa03e4808244d6b6488ef9ab7208f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:35.840669 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b386c498-45dd-4f4d-ba37-58aec16d4316 tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 200 len: 1304 microversion: 2.1 time: 0.102680 Jul 07 04:14:35.841256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 619/1203] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:35 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:36.226853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:36.227661 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:36.234888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:36.235479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:36.236300 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:36.236750 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:36.474692 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:36.482484 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-e65c246e-f4fc-4586-8389-be958de0def0 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.260090 Jul 07 04:14:36.483089 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 585/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:36 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:36.858404 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:36.859016 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] [instance: 6159cf80-a0d8-47f7-8a14-464a33c5a7ac] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:36.865539 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:36.865990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:36.867246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:36.867690 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:36.880658 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] HTTP exception thrown: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Request method failure captured: Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac HTTP/1.1 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixl2Zfxo5rHqHNT9NorpkmkJThR3tZrSlmA33ny3363h0sXz2_2cpURkqnvj2IcvdaAiHJ9NtvD3ogvniSQXUf0LTTvzXuVbFjLv0DqKjruTVEtG32Dz6RQpVFhF2HtbGcE502ohO-0TmVD56oOE6_bigxwpYUbZagCSomdTXrLh6sgQ Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: f5aa03e4808244d6b6488ef9ab7208f3 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-436372568 Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:14:36.882335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5aa03e4808244d6b6488ef9ab7208f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5aa03e4808244d6b6488ef9ab7208f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5aa03e4808244d6b6488ef9ab7208f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5aa03e4808244d6b6488ef9ab7208f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-436372568 Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: f5aa03e4808244d6b6488ef9ab7208f3 Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-436372568 Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-436372568-project Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 527c25b9a9474134b5922e78e78e2abd Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-436372568-project Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. Jul 07 04:14:36.884813 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '6159cf80-a0d8-47f7-8a14-464a33c5a7ac'} Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:14:36.885825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. Jul 07 04:14:36.887393 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:36.888829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] Returning 404 to user: Instance 6159cf80-a0d8-47f7-8a14-464a33c5a7ac could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:14:36.888829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-138ea479-6abd-4c72-9966-9aeece8cfedb tempest-VolumesNegativeTest-436372568 tempest-VolumesNegativeTest-436372568-project] 10.222.0.20 "GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac" status: 404 len: 111 microversion: 2.1 time: 0.030042 Jul 07 04:14:36.888829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 620/1205] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:36 2022] GET /compute/v2.1/servers/6159cf80-a0d8-47f7-8a14-464a33c5a7ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:14:37.499817 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:37.500755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:37.507675 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:37.508196 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:37.509725 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:37.510507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:37.645339 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:37.652974 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b1971e2b-79bb-496e-9dd4-8b3d5d2c0e2e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.156932 Jul 07 04:14:37.653543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 586/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:37 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:38.670087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:38.670703 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:38.677200 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:38.677649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:38.678413 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:38.678847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:38.818606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:38.827176 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-abaabb52-a98b-4e5f-b8f2-b7d443bf45b7 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.161023 Jul 07 04:14:38.827739 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 621/1207] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:38 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:39.133561 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-4b778c40-ecb2-4a3d-8a32-f1c3d6a40f7f req-3bbc48d1-f6ff-45ac-8b5a-f13aca2149c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "name": "network-vif-unplugged", "status": "completed", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:39.142745 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-4b778c40-ecb2-4a3d-8a32-f1c3d6a40f7f req-3bbc48d1-f6ff-45ac-8b5a-f13aca2149c2 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:39.143191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-4b778c40-ecb2-4a3d-8a32-f1c3d6a40f7f req-3bbc48d1-f6ff-45ac-8b5a-f13aca2149c2 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:39.156967 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-4b778c40-ecb2-4a3d-8a32-f1c3d6a40f7f req-3bbc48d1-f6ff-45ac-8b5a-f13aca2149c2 service nova] Creating event network-vif-unplugged:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:14:39.164214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-4b778c40-ecb2-4a3d-8a32-f1c3d6a40f7f req-3bbc48d1-f6ff-45ac-8b5a-f13aca2149c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033342 Jul 07 04:14:39.164214 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 587/1208] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:14:39.844477 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:39.845095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:39.851644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:39.852095 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:39.853659 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:39.854102 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:39.985441 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:39.992781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-52889be4-ad97-4b2f-8276-aba5c62955dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.152349 Jul 07 04:14:39.993426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 622/1209] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:39 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:41.011253 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:41.012001 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:41.018143 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:41.018593 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:41.019360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:41.019800 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:41.167011 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:41.174725 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c183a662-5e8c-482b-aa17-0aa2404b8338 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.168307 Jul 07 04:14:41.175307 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 588/1210] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:41 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:42.192816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:42.193439 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:42.200712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:42.201165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:42.201923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:42.202530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:42.346045 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:42.354252 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-24bb1aaa-a6c2-4045-b8be-19d56c1edc88 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1576 microversion: 2.1 time: 0.165208 Jul 07 04:14:42.354825 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 623/1211] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:42 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:42.627898 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-bffcf8c5-25fa-486e-b0cf-c8e4f23e073a req-fe2b62a5-1789-4674-876a-6a58f537fed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0418bbdf-4356-43e9-a3a2-3afea528bd47", "name": "network-vif-deleted", "tag": "d758f283-81fa-470a-9286-301290aee4ba"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:42.637198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-bffcf8c5-25fa-486e-b0cf-c8e4f23e073a req-fe2b62a5-1789-4674-876a-6a58f537fed8 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:42.638114 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-bffcf8c5-25fa-486e-b0cf-c8e4f23e073a req-fe2b62a5-1789-4674-876a-6a58f537fed8 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:42.649406 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-bffcf8c5-25fa-486e-b0cf-c8e4f23e073a req-fe2b62a5-1789-4674-876a-6a58f537fed8 service nova] Creating event network-vif-deleted:d758f283-81fa-470a-9286-301290aee4ba for instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 on hv-cinder-84684 Jul 07 04:14:42.655090 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-bffcf8c5-25fa-486e-b0cf-c8e4f23e073a req-fe2b62a5-1789-4674-876a-6a58f537fed8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 Jul 07 04:14:42.655677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 589/1212] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:14:43.371927 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:43.372596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:43.379713 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:43.380166 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:43.380963 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:43.381405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:43.403097 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:43.419462 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:43.419917 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:43.420646 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lazy-loading 'fault' on Instance uuid 0418bbdf-4356-43e9-a3a2-3afea528bd47 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:14:43.468984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:43.475656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-449989dc-10b8-48af-9b90-37adfb61e3dc tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 200 len: 1184 microversion: 2.1 time: 0.108728 Jul 07 04:14:43.476223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 624/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:43 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 1184 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:44.494545 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:44.495262 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 0418bbdf-4356-43e9-a3a2-3afea528bd47] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:44.501754 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:44.502204 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:44.502966 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:44.503400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:44.516916 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] HTTP exception thrown: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Request method failure captured: Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 HTTP/1.1 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlszwDCyKn8fBDt4LiNs3hShrHJEpoTgOANIFKaiZPSeckjS8tpiN26khkm-eyUm9OHVz2LzWroYVUDZIkn9SGCIJBNKGwQqhPXVs6D5_vmdnSVN13BCJzYj4jPb5QFhsZ97tN3coYBO4IqE1xhVi47_qdCaKAjXr4TwA3SMZ2N_kKA Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:14:44.518515 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: f90b6a7eecf247ac9baa9351ae51096d Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. Jul 07 04:14:44.520195 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '0418bbdf-4356-43e9-a3a2-3afea528bd47'} Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:14:44.521166 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. Jul 07 04:14:44.522700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:44.524063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Returning 404 to user: Instance 0418bbdf-4356-43e9-a3a2-3afea528bd47 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:14:44.524063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-120e9905-2901-4168-8d52-d86a5cb5c823 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47" status: 404 len: 111 microversion: 2.1 time: 0.030659 Jul 07 04:14:44.524063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 590/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:44 2022] GET /compute/v2.1/servers/0418bbdf-4356-43e9-a3a2-3afea528bd47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:14:47.694454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:47.694989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:47.695677 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-41488c22-254f-43ec-85d1-cd5d0afc291f req-23b9e53b-e0e5-40ec-a3e1-2064230bbbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9966850f-458c-4317-ab66-5b231051af76", "tag": "a8d6e540-db2d-4268-b805-0a7b254ab005"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:47.702101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:47.702683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:47.703454 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:47.704089 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:47.706475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-41488c22-254f-43ec-85d1-cd5d0afc291f req-23b9e53b-e0e5-40ec-a3e1-2064230bbbb5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:47.706920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-41488c22-254f-43ec-85d1-cd5d0afc291f req-23b9e53b-e0e5-40ec-a3e1-2064230bbbb5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:47.719358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-41488c22-254f-43ec-85d1-cd5d0afc291f req-23b9e53b-e0e5-40ec-a3e1-2064230bbbb5 service nova] Creating event network-changed:a8d6e540-db2d-4268-b805-0a7b254ab005 for instance 9966850f-458c-4317-ab66-5b231051af76 on hv-cinder-84684 Jul 07 04:14:47.724294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-41488c22-254f-43ec-85d1-cd5d0afc291f req-23b9e53b-e0e5-40ec-a3e1-2064230bbbb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032227 Jul 07 04:14:47.724883 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 591/1215] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:14:47.732100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:14:47.820411 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fa04b273-475a-4f76-bd19-acb3abb00f5f tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 204 len: 0 microversion: 2.1 time: 0.130094 Jul 07 04:14:47.821064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 625/1216] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:14:47 2022] DELETE /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:14:47.831586 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:47.832313 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:47.841931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:47.842385 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:47.843177 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:47.843614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:47.977906 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:47.986419 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-df4a2f8f-2a52-44b2-8e51-9cb8d8c9866e tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1577 microversion: 2.1 time: 0.159745 Jul 07 04:14:47.987000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 592/1217] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:47 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:49.005469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:49.006263 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:49.008799 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:49.014426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:49.014877 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:49.015698 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:49.016141 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:49.152683 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90b6a7eecf247ac9baa9351ae51096d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90ba1d25fd3421796320121b8a38fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:14:49.160368 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-33c7ecad-9995-49a4-a622-c1a00d3a1ca3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 200 len: 1458 microversion: 2.1 time: 0.159046 Jul 07 04:14:49.161152 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 626/1218] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:48 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:14:49.739540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-1c9c6b70-b669-4ea8-939c-d9904c1d9e60 req-85744d0d-ee3d-4585-8371-f27624c74c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9966850f-458c-4317-ab66-5b231051af76", "name": "network-vif-deleted", "tag": "a8d6e540-db2d-4268-b805-0a7b254ab005"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:14:49.744498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:49.750533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-1c9c6b70-b669-4ea8-939c-d9904c1d9e60 req-85744d0d-ee3d-4585-8371-f27624c74c60 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:49.750923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-1c9c6b70-b669-4ea8-939c-d9904c1d9e60 req-85744d0d-ee3d-4585-8371-f27624c74c60 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:49.755048 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:49.763536 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-1c9c6b70-b669-4ea8-939c-d9904c1d9e60 req-85744d0d-ee3d-4585-8371-f27624c74c60 service nova] Creating event network-vif-deleted:a8d6e540-db2d-4268-b805-0a7b254ab005 for instance 9966850f-458c-4317-ab66-5b231051af76 on hv-cinder-84684 Jul 07 04:14:49.768710 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-1c9c6b70-b669-4ea8-939c-d9904c1d9e60 req-85744d0d-ee3d-4585-8371-f27624c74c60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Jul 07 04:14:49.769282 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 593/1219] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:14:50.178459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:50.179001 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: 9966850f-458c-4317-ab66-5b231051af76] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:50.185485 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.185936 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.186692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.187129 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.200596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] HTTP exception thrown: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Request method failure captured: Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 HTTP/1.1 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlszwDCyKn8fBDt4LiNs3hShrHJEpoTgOANIFKaiZPSeckjS8tpiN26khkm-eyUm9OHVz2LzWroYVUDZIkn9SGCIJBNKGwQqhPXVs6D5_vmdnSVN13BCJzYj4jPb5QFhsZ97tN3coYBO4IqE1xhVi47_qdCaKAjXr4TwA3SMZ2N_kKA Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:14:50.202224 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f90b6a7eecf247ac9baa9351ae51096d Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. Jul 07 04:14:50.203966 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '9966850f-458c-4317-ab66-5b231051af76'} Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:14:50.204879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. Jul 07 04:14:50.206307 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.207564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Returning 404 to user: Instance 9966850f-458c-4317-ab66-5b231051af76 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:14:50.207564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6d3c7789-3844-4309-b830-c13250bec080 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76" status: 404 len: 111 microversion: 2.1 time: 0.029144 Jul 07 04:14:50.207564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 627/1220] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:50 2022] GET /compute/v2.1/servers/9966850f-458c-4317-ab66-5b231051af76 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:14:50.650073 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:50.650654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:50.657050 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.657492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.658241 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.658670 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.671996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] HTTP exception thrown: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Request method failure captured: Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 HTTP/1.1 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlszwDCyKn8fBDt4LiNs3hShrHJEpoTgOANIFKaiZPSeckjS8tpiN26khkm-eyUm9OHVz2LzWroYVUDZIkn9SGCIJBNKGwQqhPXVs6D5_vmdnSVN13BCJzYj4jPb5QFhsZ97tN3coYBO4IqE1xhVi47_qdCaKAjXr4TwA3SMZ2N_kKA Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:14:50.673646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: f90b6a7eecf247ac9baa9351ae51096d Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.675318 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'dc26698e-e0d0-4fd6-8cc1-607d89ebb414'} Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:14:50.676254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.677591 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.678922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Returning 404 to user: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:14:50.678922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-322b723c-17d0-485d-aa0d-3fdb08274b46 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 404 len: 111 microversion: 2.1 time: 0.030603 Jul 07 04:14:50.678922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 594/1221] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:14:50 2022] DELETE /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:14:50.684652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:50.685259 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] [instance: dc26698e-e0d0-4fd6-8cc1-607d89ebb414] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:14:50.691143 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.691584 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.692361 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:14:50.692794 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:14:50.706558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] HTTP exception thrown: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Request method failure captured: Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 HTTP/1.1 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlszwDCyKn8fBDt4LiNs3hShrHJEpoTgOANIFKaiZPSeckjS8tpiN26khkm-eyUm9OHVz2LzWroYVUDZIkn9SGCIJBNKGwQqhPXVs6D5_vmdnSVN13BCJzYj4jPb5QFhsZ97tN3coYBO4IqE1xhVi47_qdCaKAjXr4TwA3SMZ2N_kKA Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:14:50.708313 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d90ba1d25fd3421796320121b8a38fa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: d90ba1d25fd3421796320121b8a38fa1 Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-TestVolumeBootPattern-64413915 Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f90b6a7eecf247ac9baa9351ae51096d Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-TestVolumeBootPattern-64413915-project Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.709775 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'dc26698e-e0d0-4fd6-8cc1-607d89ebb414'} Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:14:50.710549 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. Jul 07 04:14:50.711897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:14:50.713347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Returning 404 to user: Instance dc26698e-e0d0-4fd6-8cc1-607d89ebb414 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:14:50.713347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-26c696d1-365d-461e-8fe8-18a02a417517 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414" status: 404 len: 111 microversion: 2.1 time: 0.029684 Jul 07 04:14:50.713347 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 628/1222] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:14:50 2022] GET /compute/v2.1/servers/dc26698e-e0d0-4fd6-8cc1-607d89ebb414 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:14:52.000018 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-035768db-796d-4d2d-a64d-468735e07ed3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] Calling method '.version_select at 0x7ff655678430>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:14:52.018679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-035768db-796d-4d2d-a64d-468735e07ed3 tempest-TestVolumeBootPattern-64413915 tempest-TestVolumeBootPattern-64413915-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1275067466" status: 202 len: 0 microversion: 2.1 time: 0.022386 Jul 07 04:14:52.019264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 595/1223] 10.222.0.20 () {58 vars in 1262 bytes} [Thu Jul 7 04:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1275067466 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:15:11.108423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:15:11.109073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:15:13.955620 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:13.956223 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:13.959087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=5 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:13.959087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:13.964808 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:13.965252 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:13.966010 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:13.966441 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:13.990852 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8626935b-5348-4c06-a846-eb5c1bc02cac tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/ips" status: 200 len: 151 microversion: 2.1 time: 0.039237 Jul 07 04:15:13.991414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 629/1224] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:15:13 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:15.299013 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=3 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:15.299755 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:15.303756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea462c3-a82c-454f-b7a4-c0eb9007d8c2"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:15.305694 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:15.313205 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:15.313654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:15.314409 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:15.314845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:15.565513 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6fc08973-b86d-4f2d-a784-7c9518fece8d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267664 Jul 07 04:15:15.566142 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 596/1225] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:15:15 2022] POST /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:23.052809 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea462c3-a82c-454f-b7a4-c0eb9007d8c2"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:23.053879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:23.061050 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.061498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.062250 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.062682 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.142195 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments HTTP/1.1 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 74 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:15:23.143816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {"volumeAttachment": {"volumeId": "dea462c3-a82c-454f-b7a4-c0eb9007d8c2"}} Jul 07 04:15:23.145627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'server_id': '95850d83-f1a7-4262-8c08-8325c1338d59', 'body': {'volumeAttachment': {'volumeId': 'dea462c3-a82c-454f-b7a4-c0eb9007d8c2'}}} Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:15:23.146651 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:23.148236 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 400 to user: Invalid volume: volume dea462c3-a82c-454f-b7a4-c0eb9007d8c2 is already attached to instances: 95850d83-f1a7-4262-8c08-8325c1338d59 {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-38e4e51c-fdf1-4e57-8cbb-d2cebfa0f124 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096419 Jul 07 04:15:23.149888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 630/1226] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:15:23 2022] POST /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 04:15:23.208100 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:23.208642 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:23.214849 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.215294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.216046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.216514 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.293958 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lazy-loading 'services' on Instance uuid 95850d83-f1a7-4262-8c08-8325c1338d59 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:15:23.366288 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-563c0ab0-9cae-491e-9cc0-9e135de5cc81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments/dea462c3-a82c-454f-b7a4-c0eb9007d8c2" status: 202 len: 0 microversion: 2.1 time: 0.162727 Jul 07 04:15:23.366902 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 597/1227] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:15:23 2022] DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments/dea462c3-a82c-454f-b7a4-c0eb9007d8c2 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:15:23.375819 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:23.376870 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:23.383644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.384262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.385781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:23.386342 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:23.420534 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2215de0c-c848-4108-96ad-e12288c0b209 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048582 Jul 07 04:15:23.421084 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 631/1228] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:15:23 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:24.434362 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:24.435456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:24.441701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.442146 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.442944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.443375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.472573 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-2074dc67-b5c9-4c40-a565-9e6709baf691 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043904 Jul 07 04:15:24.473130 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 598/1229] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:15:24 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 04:15:24.529791 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:24.530288 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:24.536456 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.536908 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.537666 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.538101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.562501 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:15:24.634109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ea656386-d641-4404-b402-ed2b840ca0d2 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 204 len: 0 microversion: 2.1 time: 0.108552 Jul 07 04:15:24.634701 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 632/1230] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:15:24 2022] DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:15:24.642969 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:24.643578 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:24.649853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.650304 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.651128 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:24.652139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:24.780829 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:24.788459 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-936d1b8d-43ab-41c9-9f81-45ae8a2a7e4d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1683 microversion: 2.1 time: 0.149241 Jul 07 04:15:24.789068 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 599/1231] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:24 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:25.805800 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:25.806502 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:25.813429 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:25.813875 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:25.814622 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:25.815053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:25.946677 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:25.954107 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-46ef1fe8-161e-4c6b-85b8-10cd39f003c4 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1683 microversion: 2.1 time: 0.152430 Jul 07 04:15:25.954697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 633/1232] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:25 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:15:26.971595 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:26.972329 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:26.978890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:26.979407 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:26.980888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:26.981583 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:27.110842 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:27.118838 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0c0bec9d-da9a-4735-aa12-67a372b6ad79 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 200 len: 1683 microversion: 2.1 time: 0.151051 Jul 07 04:15:27.119422 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 600/1233] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:26 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:27.498156 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ae5de88e-5d9a-49fe-b5a0-5f302b97f96a req-6d195c62-490b-4ce5-9dc6-b47740318259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95850d83-f1a7-4262-8c08-8325c1338d59", "name": "network-vif-deleted", "tag": "a1c0c04a-4a51-45a0-a789-60c406c4aab5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:27.507277 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ae5de88e-5d9a-49fe-b5a0-5f302b97f96a req-6d195c62-490b-4ce5-9dc6-b47740318259 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:27.507714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ae5de88e-5d9a-49fe-b5a0-5f302b97f96a req-6d195c62-490b-4ce5-9dc6-b47740318259 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:27.519206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ae5de88e-5d9a-49fe-b5a0-5f302b97f96a req-6d195c62-490b-4ce5-9dc6-b47740318259 service nova] Creating event network-vif-deleted:a1c0c04a-4a51-45a0-a789-60c406c4aab5 for instance 95850d83-f1a7-4262-8c08-8325c1338d59 on hv-cinder-84684 Jul 07 04:15:27.524818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-ae5de88e-5d9a-49fe-b5a0-5f302b97f96a req-6d195c62-490b-4ce5-9dc6-b47740318259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 Jul 07 04:15:27.525652 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 634/1234] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:28.137600 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:28.138156 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:28.144709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:28.145160 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:28.145926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:28.146356 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:28.160604 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 HTTP/1.1 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:15:28.162263 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:15:28.163895 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '95850d83-f1a7-4262-8c08-8325c1338d59'} Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:15:28.168185 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:15:28.169785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:15:28.171240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:15:28.171240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-aa2ab4e1-d5f5-4e9c-bc4b-06b9fc43c03c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 404 len: 111 microversion: 2.1 time: 0.030549 Jul 07 04:15:28.171240 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 601/1235] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:28 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:28.177111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-98a378b7-56d1-4ba9-9db5-1a495698dad9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '.version_select at 0x7ff655796a60>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:28.201747 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-98a378b7-56d1-4ba9-9db5-1a495698dad9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918060103" status: 202 len: 0 microversion: 2.1 time: 0.028648 Jul 07 04:15:28.202882 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 635/1236] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jul 7 04:15:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918060103 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:15:28.833658 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-345e22df-1488-42fd-b7db-2eb0fad776bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: .version_select at 0x7ff655757700>, body: {"keypair": {"name": "tempest-keypair-1711487799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8jZAAlj7ldtXFTyzs5azqirTFSRQsD3xB5Wu+1vnt86ycHv6LbkLGVepJYy+O1GECIZrZ1gUpgZFvLFx5u1tWex3h8crqPHwlWNxyXIH1IWfUrmG7i+4WqCI035m9JQQ=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:28.847946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-345e22df-1488-42fd-b7db-2eb0fad776bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:15:28.851752 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-345e22df-1488-42fd-b7db-2eb0fad776bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:15:28.872791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-345e22df-1488-42fd-b7db-2eb0fad776bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043056 Jul 07 04:15:28.873361 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 602/1237] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:15:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:30.154362 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1735777664", "imageRef": "2797805c-983d-4702-b525-32caa809dcc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb43ae82-16c6-4173-a04e-f756cd39db29"}], "security_groups": [{"name": "tempest-securitygroup--1375748590"}], "key_name": "tempest-keypair-1711487799", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:30.258849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] validate_networks() for [('eb43ae82-16c6-4173-a04e-f756cd39db29', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:15:30.627360 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:15:30.627785 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:15:30.628309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:15:30.628722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:15:30.629129 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:15:30.638673 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:30.639125 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:30.639922 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:30.640387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:30.657576 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:15:30.661508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Getting quotas for user 132f092419964477b36e23a733788982 and project e574669b298f444ba227b05dff4cd0fe. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:15:30.673422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:15:30.675769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2797805c-983d-4702-b525-32caa809dcc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:15:30.720989 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7de20102-f8a9-4fb9-af0a-63f9f8851afb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572246 Jul 07 04:15:30.721804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 636/1238] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:15:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:15:30.732962 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-229c4428-7553-4f2d-9d4d-34687736c30b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:30.733698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-229c4428-7553-4f2d-9d4d-34687736c30b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:30.788545 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-229c4428-7553-4f2d-9d4d-34687736c30b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:30.795278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-229c4428-7553-4f2d-9d4d-34687736c30b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1242 microversion: 2.1 time: 0.067496 Jul 07 04:15:30.800291 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 603/1239] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:30 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:31.812304 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:31.813165 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:31.821264 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:31.821765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:31.822830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:31.823585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:31.900648 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:31.910477 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-83b0ff7d-806f-4ab5-bed9-8ec69b21ddf6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1312 microversion: 2.1 time: 0.102855 Jul 07 04:15:31.911580 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 637/1240] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:31 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:32.927785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:32.928557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:32.935046 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:32.935492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:32.936254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:32.936716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:33.077192 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:33.084636 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-3e382fd7-a24b-4909-b38e-173dead301bb tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.160602 Jul 07 04:15:33.085202 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 604/1241] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:32 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:33.479445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-4d9ea1e4-5564-4b52-80b8-3d4ff8479976 req-1e974f86-454d-4971-872c-5c8802533b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e22275c-b4dd-4ebc-abd3-a305595ae9ba", "tag": "7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:33.489829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4d9ea1e4-5564-4b52-80b8-3d4ff8479976 req-1e974f86-454d-4971-872c-5c8802533b26 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:33.490272 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-4d9ea1e4-5564-4b52-80b8-3d4ff8479976 req-1e974f86-454d-4971-872c-5c8802533b26 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:33.502691 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-4d9ea1e4-5564-4b52-80b8-3d4ff8479976 req-1e974f86-454d-4971-872c-5c8802533b26 service nova] Creating event network-changed:7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63 for instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba on hv-cinder-84684 Jul 07 04:15:33.507888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-4d9ea1e4-5564-4b52-80b8-3d4ff8479976 req-1e974f86-454d-4971-872c-5c8802533b26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Jul 07 04:15:33.511262 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 638/1242] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:15:34.102325 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:34.102944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:34.110254 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:34.110701 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:34.111456 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:34.111894 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:34.241758 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:34.249791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f1674b80-f99e-4c6f-bf20-bf1b08780553 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.151361 Jul 07 04:15:34.250357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 605/1243] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:34 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:35.267601 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:35.268329 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:35.274527 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:35.274982 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:35.275734 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:35.276169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:35.408441 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:35.415696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-05d01ddc-2eef-4c2f-a5ce-7310e30c93f5 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.152996 Jul 07 04:15:35.416258 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 639/1244] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:35 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:36.432129 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:36.433366 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:36.440131 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:36.440618 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:36.441396 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:36.441836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:36.572851 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:36.581541 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-01c9fbff-b46a-489b-81e5-4c0ada96bfe7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.153139 Jul 07 04:15:36.582049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 606/1245] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:36 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:37.598949 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:37.599558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:37.606075 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:37.606782 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:37.607536 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:37.607969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:37.746636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:37.753964 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0866ac43-8ef6-413d-96a8-982cd56fbc50 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.158881 Jul 07 04:15:37.754530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 640/1246] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:37 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:38.770941 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:38.771477 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:38.778630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:38.779069 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:38.779818 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:38.780247 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:38.912762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:38.921381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ee58d550-ab38-457b-91d7-bfdf4d5bbb96 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.154334 Jul 07 04:15:38.921939 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 607/1247] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:38 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:39.528711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-3c79959a-36a6-4729-9571-cb7300609cb9 req-1bab602d-2bda-4249-8d5b-29f248afd6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e22275c-b4dd-4ebc-abd3-a305595ae9ba", "name": "network-vif-plugged", "status": "completed", "tag": "7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:39.536788 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3c79959a-36a6-4729-9571-cb7300609cb9 req-1bab602d-2bda-4249-8d5b-29f248afd6f1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:39.537234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3c79959a-36a6-4729-9571-cb7300609cb9 req-1bab602d-2bda-4249-8d5b-29f248afd6f1 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:39.548793 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-3c79959a-36a6-4729-9571-cb7300609cb9 req-1bab602d-2bda-4249-8d5b-29f248afd6f1 service nova] Creating event network-vif-plugged:7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63 for instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba on hv-cinder-84684 Jul 07 04:15:39.553802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-3c79959a-36a6-4729-9571-cb7300609cb9 req-1bab602d-2bda-4249-8d5b-29f248afd6f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155064 Jul 07 04:15:39.554503 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 641/1248] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:39.938993 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:39.939614 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:39.946101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:39.946549 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:39.947309 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:39.947744 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:40.073654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:40.081081 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-46f5ec67-aa90-4c2c-b98d-22cb8a197c6c tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.145983 Jul 07 04:15:40.081654 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 608/1249] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:39 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:41.098587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:41.099286 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:41.101718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:41.102681 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:41.109054 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:41.109445 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:41.110206 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:41.110641 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:41.248119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:41.255550 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b962f253-0812-4f52-86ab-ee15c16a66f1 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1368 microversion: 2.1 time: 0.161155 Jul 07 04:15:41.256113 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 642/1250] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:41 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:42.273854 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:42.274417 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:42.276381 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:42.282086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:42.282528 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:42.283299 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:42.283716 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:42.410105 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:15:42.417442 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6afc0394-90ae-4792-bda1-329f803ac9a9 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1558 microversion: 2.1 time: 0.147584 Jul 07 04:15:42.418016 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 609/1251] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:15:42 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:15:42.434122 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:15:42.435235 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:15:42.441897 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:42.442346 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:42.443114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:42.443551 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:42.522712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-66133194-c138-4c31-b561-9358875f0cbe tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092351 Jul 07 04:15:42.523312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 643/1252] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jul 7 04:15:42 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:15:43.753696 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-f69300f1-9ad5-4221-823a-3801fe3cbe36 req-d0a61e74-95d4-443b-b7cf-b430356bbd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e22275c-b4dd-4ebc-abd3-a305595ae9ba", "tag": "7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:15:43.762133 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-f69300f1-9ad5-4221-823a-3801fe3cbe36 req-d0a61e74-95d4-443b-b7cf-b430356bbd16 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:15:43.763163 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-f69300f1-9ad5-4221-823a-3801fe3cbe36 req-d0a61e74-95d4-443b-b7cf-b430356bbd16 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:15:43.779782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-f69300f1-9ad5-4221-823a-3801fe3cbe36 req-d0a61e74-95d4-443b-b7cf-b430356bbd16 service nova] Creating event network-changed:7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63 for instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba on hv-cinder-84684 Jul 07 04:15:43.785352 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-f69300f1-9ad5-4221-823a-3801fe3cbe36 req-d0a61e74-95d4-443b-b7cf-b430356bbd16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095083 Jul 07 04:15:43.785960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 610/1253] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:16:55.208799 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:16:55.209498 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:16:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:16:58.662203 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:58.662976 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:58.667070 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:16:58.667560 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:16:58.675529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:16:58.675971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:16:58.676763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:16:58.677192 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:16:58.701582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0b0f22c7-5d26-4f1f-8a22-0d00875f7e82 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/ips" status: 200 len: 148 microversion: 2.1 time: 0.041255 Jul 07 04:16:58.702149 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 644/1254] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:16:58 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:00.015702 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:17:00.016479 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:17:00.021523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd2ef6f6-a5cb-4f88-b2b5-06f709840323"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:17:00.022659 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:00.031238 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:00.031685 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:00.032475 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:00.032975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:00.288209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4051d59b-ea26-4f18-90ae-d263679101a6 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "POST /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274181 Jul 07 04:17:00.288978 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 611/1255] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:17:00 2022] POST /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:07.862629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:07.863153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:07.869496 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:07.869939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:07.870722 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:07.871153 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:07.955117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lazy-loading 'services' on Instance uuid 8e22275c-b4dd-4ebc-abd3-a305595ae9ba {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:17:08.028976 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4fa03e81-33df-4862-8ffa-24b3bd659a0d tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments/bd2ef6f6-a5cb-4f88-b2b5-06f709840323" status: 202 len: 0 microversion: 2.1 time: 0.170150 Jul 07 04:17:08.029594 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 645/1256] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:17:07 2022] DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments/bd2ef6f6-a5cb-4f88-b2b5-06f709840323 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:17:08.039809 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:08.040905 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:08.049726 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:08.050176 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:08.050943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:08.051742 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:08.082471 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-63f02855-1d87-4ec6-a720-943b10c3fd81 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047180 Jul 07 04:17:08.083035 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 612/1257] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:17:08 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:09.095394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:09.096449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:09.102591 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.103040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.103820 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.104253 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.132562 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6e3a8d2d-79af-4ddd-b1a7-12f65df2ae85 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042139 Jul 07 04:17:09.133109 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 646/1258] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:17:09 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 04:17:09.191874 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:09.192413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:09.198782 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.199230 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.199995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.200472 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.224451 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Going to try to terminate instance {{(pid=117995) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:17:09.299335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-75fa5227-9e08-458f-8fb5-0759518d0269 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 204 len: 0 microversion: 2.1 time: 0.111321 Jul 07 04:17:09.300000 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 613/1259] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:17:09 2022] DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:17:09.308801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:09.309414 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:09.316053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.316530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.317281 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:09.317708 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:09.450012 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:17:09.458303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b2276e17-bccc-436f-a95e-df3d8368438b tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1681 microversion: 2.1 time: 0.153400 Jul 07 04:17:09.458866 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 647/1260] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:09 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:17:10.476297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:10.477032 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:10.483831 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:10.484306 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:10.485070 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:10.485534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:10.612587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:17:10.620010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0670efd7-3ff0-4fc6-bb53-393dc99a50c7 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1681 microversion: 2.1 time: 0.147957 Jul 07 04:17:10.620628 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 614/1261] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:10 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:17:11.637973 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:11.638596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:11.645777 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:11.646230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:11.647002 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:11.647442 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:11.717450 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132f092419964477b36e23a733788982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e574669b298f444ba227b05dff4cd0fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:17:11.725743 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cfac2d9e-d075-4fb4-85c0-c723d8de6692 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 200 len: 1613 microversion: 2.1 time: 0.091654 Jul 07 04:17:11.726310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 648/1262] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:11 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:17:12.038068 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-14d92633-1be2-4549-9433-fbcd4200c462 req-c8cf17d5-005f-45f6-8269-454ffe43abbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e22275c-b4dd-4ebc-abd3-a305595ae9ba", "name": "network-vif-deleted", "tag": "7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:17:12.050481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-14d92633-1be2-4549-9433-fbcd4200c462 req-c8cf17d5-005f-45f6-8269-454ffe43abbf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:12.051019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-14d92633-1be2-4549-9433-fbcd4200c462 req-c8cf17d5-005f-45f6-8269-454ffe43abbf service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:12.065533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-14d92633-1be2-4549-9433-fbcd4200c462 req-c8cf17d5-005f-45f6-8269-454ffe43abbf service nova] Creating event network-vif-deleted:7dcf3ab4-8e9d-4eb1-9fe0-31fa53c48a63 for instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba on hv-cinder-84684 Jul 07 04:17:12.072679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-14d92633-1be2-4549-9433-fbcd4200c462 req-c8cf17d5-005f-45f6-8269-454ffe43abbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100557 Jul 07 04:17:12.074164 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 615/1263] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 04:17:12.742903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:12.743655 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:12.750341 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:12.750786 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:12.752354 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:12.752907 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:12.767758 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba HTTP/1.1 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:12.769636 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:12.771380 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '8e22275c-b4dd-4ebc-abd3-a305595ae9ba'} Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:12.772364 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:12.773990 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:12.775706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:12.775706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fce26b75-4115-48fc-9063-162b8a14a4ca tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 404 len: 111 microversion: 2.1 time: 0.031982 Jul 07 04:17:12.775706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 649/1264] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:12 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:12.780402 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1528d258-c380-4c99-a16c-bbca10df93f3 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '.version_select at 0x7ff65597f310>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:12.798679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1528d258-c380-4c99-a16c-bbca10df93f3 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711487799" status: 202 len: 0 microversion: 2.1 time: 0.022417 Jul 07 04:17:12.799490 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 616/1265] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Jul 7 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711487799 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:17:14.533971 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:14.534459 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:14.540979 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:14.541432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:14.542201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:14.542644 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:14.555980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba HTTP/1.1 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:14.557538 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.558970 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '8e22275c-b4dd-4ebc-abd3-a305595ae9ba'} Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:14.559952 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.561603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.563248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:14.563248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5cb3aaf4-c2ee-42d2-bd4a-8c102dcc9215 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 404 len: 111 microversion: 2.1 time: 0.029495 Jul 07 04:17:14.563248 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 650/1266] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:17:14 2022] DELETE /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:14.567783 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:14.568565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 8e22275c-b4dd-4ebc-abd3-a305595ae9ba] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:14.575231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:14.575686 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:14.576489 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:14.576932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:14.592762 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba HTTP/1.1 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:17:14.594369 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.596644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '8e22275c-b4dd-4ebc-abd3-a305595ae9ba'} Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:14.597432 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. Jul 07 04:17:14.598774 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:14.599923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 8e22275c-b4dd-4ebc-abd3-a305595ae9ba could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:14.599923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b212be25-75ed-4a0f-b025-6aa3f23e3530 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba" status: 404 len: 111 microversion: 2.1 time: 0.033000 Jul 07 04:17:14.599923 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 617/1267] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:14 2022] GET /compute/v2.1/servers/8e22275c-b4dd-4ebc-abd3-a305595ae9ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:15.729455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:15.729944 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:15.737267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.737719 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.738477 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.738911 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.752036 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 HTTP/1.1 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:15.753592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.755214 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '95850d83-f1a7-4262-8c08-8325c1338d59'} Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:15.756039 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.757520 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.759231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:15.759231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d3c8b833-dc6e-4011-ab83-7c49b801d30f tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 404 len: 111 microversion: 2.1 time: 0.029361 Jul 07 04:17:15.759231 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 651/1268] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:17:15 2022] DELETE /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:15.763493 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:15.764099 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 95850d83-f1a7-4262-8c08-8325c1338d59] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:15.770619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.771065 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.771807 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.772233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.787876 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 HTTP/1.1 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:17:15.789652 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.791174 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '95850d83-f1a7-4262-8c08-8325c1338d59'} Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:15.792097 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. Jul 07 04:17:15.793647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.794960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 95850d83-f1a7-4262-8c08-8325c1338d59 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:15.794960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-ba10f86f-277c-4204-a914-66fe297d7775 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59" status: 404 len: 111 microversion: 2.1 time: 0.031494 Jul 07 04:17:15.794960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 618/1269] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:15 2022] GET /compute/v2.1/servers/95850d83-f1a7-4262-8c08-8325c1338d59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:15.800246 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:15.800769 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:15.806833 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.807283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.808042 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.808510 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.821592 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 HTTP/1.1 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:15.823119 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.824765 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': 'e76e2aeb-a40d-49ce-81b1-3248e45c25f2'} Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:15.825718 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.827225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.828846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:15.828846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b22faef1-cb35-43e0-8931-0bff7e46466a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 404 len: 111 microversion: 2.1 time: 0.028717 Jul 07 04:17:15.828846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 652/1270] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:17:15 2022] DELETE /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:17:15.832647 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:15.833260 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: e76e2aeb-a40d-49ce-81b1-3248e45c25f2] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:15.839228 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.839674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.840464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:15.840900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:15.854360 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 HTTP/1.1 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:17:15.855847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.857765 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': 'e76e2aeb-a40d-49ce-81b1-3248e45c25f2'} Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:15.858740 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. Jul 07 04:17:15.860394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:15.862428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance e76e2aeb-a40d-49ce-81b1-3248e45c25f2 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:15.862428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-1fdb29ec-22a5-4562-93f5-042f3246805a tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2" status: 404 len: 111 microversion: 2.1 time: 0.028249 Jul 07 04:17:15.862428 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 619/1271] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:15 2022] GET /compute/v2.1/servers/e76e2aeb-a40d-49ce-81b1-3248e45c25f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:16.992874 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:16.993378 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:16.999781 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:17.000230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:17.001020 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:17.001482 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:17.015234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a HTTP/1.1 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:17.016790 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: > Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.018449 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '52aceba7-9cb8-4018-b6d9-564135ba117a'} Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:17.019420 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.021209 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.022736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:17.022736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5dae2b93-ad87-4825-a121-63f8a3b30d27 tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 404 len: 111 microversion: 2.1 time: 0.029153 Jul 07 04:17:17.022736 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 653/1272] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:17:16 2022] DELETE /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:17.026975 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:17.027587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] [instance: 52aceba7-9cb8-4018-b6d9-564135ba117a] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:17:17.034565 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:17.035006 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:17.035763 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:17:17.036191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:17:17.050634 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] HTTP exception thrown: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Request method failure captured: Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a HTTP/1.1 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixlwIxZoh27Hy752ncjWGI93795CQ0A6bU3ym3cVde1pwrKozg2laEjTqo8Lw3uV_tVmOBc2ztBTfvGtLAC11_ix_XvIlNJSJLmnFek6I23UbnZPTYJJz-gHjalyDIrgpswpYuevIIVdlYG2yl9zHnHz3CdxdkwkdeWcirPlaTv7nBO0 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:17:17.052136 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e574669b298f444ba227b05dff4cd0fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: e574669b298f444ba227b05dff4cd0fe Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-854869851 Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: 132f092419964477b36e23a733788982 Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-AttachVolumeNegativeTest-854869851-project Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.053931 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '52aceba7-9cb8-4018-b6d9-564135ba117a'} Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:17.054888 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. Jul 07 04:17:17.056540 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:17:17.057982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] Returning 404 to user: Instance 52aceba7-9cb8-4018-b6d9-564135ba117a could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:17.057982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9715b1a4-3041-45d9-af0f-c07363cdd08e tempest-AttachVolumeNegativeTest-854869851 tempest-AttachVolumeNegativeTest-854869851-project] 10.222.0.20 "GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a" status: 404 len: 111 microversion: 2.1 time: 0.030339 Jul 07 04:17:17.057982 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 620/1273] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:17:17 2022] GET /compute/v2.1/servers/52aceba7-9cb8-4018-b6d9-564135ba117a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:21.391303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6682722f-306c-47cb-b4b3-e98d0751f5d2 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Action: 'create', calling method: .version_select at 0x7ff6554351f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-922764726", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:17:21.675079 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6682722f-306c-47cb-b4b3-e98d0751f5d2 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.396377 Jul 07 04:17:21.675714 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 654/1274] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jul 7 04:17:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 04:17:21.686546 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a0d54431-3d07-41e2-915f-c877d646e643 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff655496550>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:21.737963 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a0d54431-3d07-41e2-915f-c877d646e643 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 200 len: 352 microversion: 2.1 time: 0.055287 Jul 07 04:17:21.738533 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 621/1275] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:17:21 2022] GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:22.750849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-582aa65c-c0bb-4c31-9fdd-1c5e71d84e2e tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff655736040>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:22.800139 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-582aa65c-c0bb-4c31-9fdd-1c5e71d84e2e tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 200 len: 353 microversion: 2.1 time: 0.053623 Jul 07 04:17:22.800737 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 655/1276] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:17:22 2022] GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:22.811907 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cbb86e95-b254-4615-89b4-13f83b3ef86d tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff6557b13a0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:22.858362 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cbb86e95-b254-4615-89b4-13f83b3ef86d tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 200 len: 353 microversion: 2.1 time: 0.050695 Jul 07 04:17:22.858925 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 622/1277] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:17:22 2022] GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:22.874801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eb32e67c-48f4-496d-8aa7-c7c4ec94ca18 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff65576e940>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:22.934879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eb32e67c-48f4-496d-8aa7-c7c4ec94ca18 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 202 len: 0 microversion: 2.1 time: 0.063849 Jul 07 04:17:22.935455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 656/1278] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jul 7 04:17:22 2022] DELETE /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:17:22.943543 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7f1efd20-9737-4b07-abd1-74d4c6c2a588 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff65583e5e0>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:22.991367 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7f1efd20-9737-4b07-abd1-74d4c6c2a588 tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 200 len: 352 microversion: 2.1 time: 0.051729 Jul 07 04:17:22.991945 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 623/1279] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:17:22 2022] GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:17:24.004017 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cf93f8c4-0e63-43fb-9aa1-7dd0c3a81dff tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Calling method '.version_select at 0x7ff65576cee0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:17:24.031232 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-cf93f8c4-0e63-43fb-9aa1-7dd0c3a81dff tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] HTTP exception thrown: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cf93f8c4-0e63-43fb-9aa1-7dd0c3a81dff tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Request method failure captured: Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 HTTP/1.1 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Connection: close Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Host: 10.222.0.20 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.9 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABixl5RRPCR_tY3LBH0tSfjuHMF76a2sHp2uYqFsglLEZHfCqRChtUsqqvui6qKMOPlpXLNpnn2C8TXJ0vr3ABcK1BLrgVTQLepgHDZQnqJnOemxqCnX_9X6uXQvROx3Ct_uVsKb1TCw3x6ml-mbJziUxfft5iiCsOQnYzrFwm0UB6hs8A Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Id: 86b3bbe0b1ae46adb4924144e58de259 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesGetTestJSON-1690457301 Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 07 04:17:24.033269 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86b3bbe0b1ae46adb4924144e58de259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b3bbe0b1ae46adb4924144e58de259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86b3bbe0b1ae46adb4924144e58de259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86b3bbe0b1ae46adb4924144e58de259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesGetTestJSON-1690457301 Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 86b3bbe0b1ae46adb4924144e58de259 Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesGetTestJSON-1690457301 Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesGetTestJSON-1690457301-project Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Id: f61da8a2974b47099b5170a666340685 Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesGetTestJSON-1690457301-project Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: method: Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: exception: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: action_args: {'id': '444e7d8c-ba30-4ce5-bef4-2434d4471e03'} Jul 07 04:17:24.034846 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. (HTTP 404) (Request-ID: req-15f717b5-9d8b-4d76-9f50-33555ba8dab8) Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:24.035903 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 04:17:24.037554 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 04:17:24.039137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cf93f8c4-0e63-43fb-9aa1-7dd0c3a81dff tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] Returning 404 to user: Volume 444e7d8c-ba30-4ce5-bef4-2434d4471e03 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cf93f8c4-0e63-43fb-9aa1-7dd0c3a81dff tempest-VolumesGetTestJSON-1690457301 tempest-VolumesGetTestJSON-1690457301-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03" status: 404 len: 109 microversion: 2.1 time: 0.035741 Jul 07 04:17:24.040626 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 657/1280] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jul 7 04:17:23 2022] GET /compute/v2.1/os-volumes/444e7d8c-ba30-4ce5-bef4-2434d4471e03 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:18:26.529191 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:26.529947 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:26.534869 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f2e72abf-7cc1-4d7f-a436-4de169b5c306 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'create', calling method: .version_select at 0x7ff65575b5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-643071137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxHx+4WVZrpUEYFQiJ8g2ztgsEDYBWzhLsjM6J0YXLcgpo51tQ6+/SWfqXgpRh7k0CxYIiKGgvFHB6QMuvKKDWxp1PhsAKlol9mwL7Zs5bHrxfQ+Xh3vpvv1lCvjGhsbQ=="}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:18:26.554250 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-f2e72abf-7cc1-4d7f-a436-4de169b5c306 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Getting quotas for project eb841fd811c449efb92c868fef5a089b. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:18:26.558049 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.quota [None req-f2e72abf-7cc1-4d7f-a436-4de169b5c306 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Getting quotas for user a11499df74e44f7ca5f00dfa04034000 and project eb841fd811c449efb92c868fef5a089b. Resources: {'key_pairs'} {{(pid=117995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:18:26.579921 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f2e72abf-7cc1-4d7f-a436-4de169b5c306 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052851 Jul 07 04:18:26.580534 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 624/1281] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jul 7 04:18:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:18:26.629564 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=20 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:26.630309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:26.634696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1383960165", "imageRef": "d5daa485-4f2c-4de8-ae51-b8a104bea7fc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-643071137", "networks": [{"uuid": "4fc196fd-375b-4db5-a35d-33c3d79eb17b"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:18:26.795044 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] validate_networks() for [('4fc196fd-375b-4db5-a35d-33c3d79eb17b', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 04:18:27.262266 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 04:18:27.262692 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 04:18:27.263163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 04:18:27.263568 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 04:18:27.263974 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 04:18:27.272859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:27.273303 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:27.274085 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:27.274514 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:27.291841 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Getting quotas for project eb841fd811c449efb92c868fef5a089b. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 04:18:27.295930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Getting quotas for user a11499df74e44f7ca5f00dfa04034000 and project eb841fd811c449efb92c868fef5a089b. Resources: {'cores', 'ram', 'instances'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 04:18:27.307047 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 04:18:27.309234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d5daa485-4f2c-4de8-ae51-b8a104bea7fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 04:18:27.349818 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [90e79231-d26f-46ec-8db1-b8bb7c28cdc1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 07 04:18:28.358320 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [90e79231-d26f-46ec-8db1-b8bb7c28cdc1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59938. Jul 07 04:18:28.362254 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-08592ba7-6c0d-4526-86bb-0fcc816f55a1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735229 Jul 07 04:18:28.362906 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 658/1282] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jul 7 04:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 04:18:28.372897 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-a1823ae6-e651-47b4-bf38-8498a5648709 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:28.373510 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-a1823ae6-e651-47b4-bf38-8498a5648709 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:28.487552 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-a1823ae6-e651-47b4-bf38-8498a5648709 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:28.494730 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-a1823ae6-e651-47b4-bf38-8498a5648709 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1258 microversion: 2.1 time: 0.125667 Jul 07 04:18:28.495473 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 625/1283] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:28 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1258 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:29.512994 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:29.513700 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:29.520532 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:29.521107 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:29.521935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:29.522467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:29.586072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:29.593960 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dbaf7a69-ea9c-4b36-a33c-2de3affd37a2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1316 microversion: 2.1 time: 0.085281 Jul 07 04:18:29.594578 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 659/1284] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:29 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1316 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:30.612441 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:30.613162 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:30.620258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:30.620732 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:30.621494 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:30.621928 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:30.761920 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:30.769557 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-cfe9cbd5-abdd-4391-a3ee-b4fb30d38d06 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.161022 Jul 07 04:18:30.770679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 626/1285] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:30 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:31.116663 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:18:31.117267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:18:31.787637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:31.788256 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:31.794849 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:31.795296 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:31.796101 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:31.796587 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:31.938593 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:31.946062 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3ed5c988-8a47-4c69-a1d8-0b5a692270ff tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.162841 Jul 07 04:18:31.946627 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 660/1286] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:31 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:32.963691 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:32.964436 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:32.970892 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:32.971371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:32.972137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:32.972603 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:33.119248 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:33.126698 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-bda955c2-3793-4c5b-860b-d71a3d99dff1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.167183 Jul 07 04:18:33.127264 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 627/1287] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:32 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:34.144293 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:34.145563 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:34.151995 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:34.152491 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:34.153267 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:34.153706 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:34.296816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:34.304664 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0629f0d0-380a-4ce5-988a-106d106f8a3e tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.164410 Jul 07 04:18:34.305215 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 661/1288] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:34 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:35.323265 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:35.324022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:35.331637 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:35.332085 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:35.333087 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:35.333335 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:35.475914 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:35.483979 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6d15a2ee-eb20-4169-bc94-05e4d4ec8690 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.165359 Jul 07 04:18:35.484587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 628/1289] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:35 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 04:18:36.501432 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:36.502163 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:36.509483 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:36.509901 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:36.510672 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:36.511111 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:36.656530 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:36.664009 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-31a386aa-51c8-4451-ac1b-3b04c040c7b4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.166412 Jul 07 04:18:36.664653 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 662/1290] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:36 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:37.681956 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:37.682535 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:37.689004 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:37.689446 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:37.690190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:37.690619 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:37.818695 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:37.826544 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-b12b1bba-e53d-4abb-a659-1f96419eb305 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.148697 Jul 07 04:18:37.827113 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 629/1291] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:37 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:38.843447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:38.844083 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:38.845969 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:38.846629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:38.852934 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:38.853394 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:38.854160 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:38.854600 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:38.983202 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:38.990737 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-414c601b-672e-4870-a77d-9f1e73b7ea9c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.151145 Jul 07 04:18:38.991299 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 663/1292] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:38 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:40.007524 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:40.008082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:40.009944 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell0:SELECT=6 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:40.015771 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:40.016218 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:40.016995 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:40.017431 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:40.143775 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:40.151991 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5b9749c3-1c1b-4c66-a392-45f063b8aafe tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.149021 Jul 07 04:18:40.152599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 630/1293] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:40 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:40.916660 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-bd27e5d3-d3f0-40a4-9d7b-b8f288ed2f4a req-00d07aee-6f6b-4723-974f-155203226ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:18:40.925930 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-bd27e5d3-d3f0-40a4-9d7b-b8f288ed2f4a req-00d07aee-6f6b-4723-974f-155203226ee5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:40.927037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-bd27e5d3-d3f0-40a4-9d7b-b8f288ed2f4a req-00d07aee-6f6b-4723-974f-155203226ee5 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:40.938923 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-bd27e5d3-d3f0-40a4-9d7b-b8f288ed2f4a req-00d07aee-6f6b-4723-974f-155203226ee5 service nova] Creating event network-changed:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:18:40.944879 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-bd27e5d3-d3f0-40a4-9d7b-b8f288ed2f4a req-00d07aee-6f6b-4723-974f-155203226ee5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Jul 07 04:18:40.945665 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 664/1294] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:18:41.168949 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:41.169655 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:41.176197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:41.176678 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:41.177445 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:41.177877 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:41.311288 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:41.319212 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-0aa4a924-00a1-407f-a912-aa4165d3916a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.154232 Jul 07 04:18:41.319795 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 631/1295] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:41 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:42.337194 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:42.337895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:42.344783 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:42.345230 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:42.345991 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:42.346426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:42.479649 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:42.487283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-82f37967-d7cc-4775-a85b-854fc5388fb9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.154858 Jul 07 04:18:42.487847 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 665/1296] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:42 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:43.505258 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:43.505872 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:43.512294 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:43.512756 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:43.513502 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:43.513932 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:43.639149 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:43.647082 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8daf91fd-1839-4a6c-b6ee-7815178a6656 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.145962 Jul 07 04:18:43.647646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 632/1297] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:43 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:44.665087 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:44.665697 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:44.672127 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:44.672621 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:44.673371 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:44.673802 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:44.808056 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:44.815402 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8c9b04ff-46c2-4bf0-86bd-fb3f3c5ff04d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.155210 Jul 07 04:18:44.815975 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 666/1298] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:44 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:45.832153 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:45.833086 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:45.839523 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:45.839970 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:45.840759 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:45.841198 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:45.969221 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:45.977116 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-63e2d792-614b-4d9a-a6d1-95a5da28671b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.148840 Jul 07 04:18:45.977709 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 633/1299] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:45 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:46.222842 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-d580d706-71a1-412a-a1c4-87733719c143 req-3070b985-c3a1-481a-8f56-ce6b82626681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "name": "network-vif-plugged", "status": "completed", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:18:46.231950 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d580d706-71a1-412a-a1c4-87733719c143 req-3070b985-c3a1-481a-8f56-ce6b82626681 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:46.232656 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d580d706-71a1-412a-a1c4-87733719c143 req-3070b985-c3a1-481a-8f56-ce6b82626681 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:46.246806 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-d580d706-71a1-412a-a1c4-87733719c143 req-3070b985-c3a1-481a-8f56-ce6b82626681 service nova] Creating event network-vif-plugged:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:18:46.251801 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-d580d706-71a1-412a-a1c4-87733719c143 req-3070b985-c3a1-481a-8f56-ce6b82626681 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032629 Jul 07 04:18:46.252546 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 667/1300] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:18:46.995268 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:46.995881 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:47.002539 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:47.002991 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:47.003785 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:47.004245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:47.130674 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:47.138074 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-001cbd2d-06db-48a1-9c46-8144590f0163 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1358 microversion: 2.1 time: 0.146643 Jul 07 04:18:47.138646 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 634/1301] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:46 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:48.156565 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:48.157447 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:48.164498 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.164948 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.165980 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.166340 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.300638 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:48.308110 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4b18b1f3-bd90-4c45-948a-ac1297016547 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1548 microversion: 2.1 time: 0.156898 Jul 07 04:18:48.308709 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 668/1302] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:48 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:48.324556 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:48.325164 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:48.331587 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.332029 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.333409 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.333836 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.460929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:48.468197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c38cdcf1-293a-49d3-a273-246a34125c92 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1548 microversion: 2.1 time: 0.147455 Jul 07 04:18:48.468791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 635/1303] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:48 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:48.484579 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:48.487951 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:48.488873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Searching by: {'deleted': False, 'project_id': 'eb841fd811c449efb92c868fef5a089b'} {{(pid=117994) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 07 04:18:48.495513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.495954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.496771 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.497204 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.585100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.multi_cell_list [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 07 04:18:48.679712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a0fdb512-9efc-4c9b-b984-30ab2a723840 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199041 Jul 07 04:18:48.680310 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 669/1304] 10.222.0.20 () {58 vars in 1124 bytes} [Thu Jul 7 04:18:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:18:48.690310 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:48.690922 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:48.697805 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.698249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.698996 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:48.699425 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:48.829223 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:48.836833 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-68159dac-7e3d-4644-9429-d86cca8f2376 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1548 microversion: 2.1 time: 0.150263 Jul 07 04:18:48.837332 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 636/1305] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:48 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:18:50.346114 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93452897-0eb5-4998-8591-fa644144b281"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:18:50.347186 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:50.354261 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:50.354711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:50.355469 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:50.355939 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:50.602618 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1f2479f5-d2e0-4da7-a548-6f530a909ca2 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260284 Jul 07 04:18:50.603222 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 670/1306] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jul 7 04:18:50 2022] POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:18:58.141863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:18:58.142483 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:18:58.144532 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:58.149847 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:58.150297 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:58.151055 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:18:58.151488 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:18:58.156026 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=67 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:58.286485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:18:58.294370 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-7ff4a2f5-edd0-4d91-8e90-c6e2db832c26 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1594 microversion: 2.1 time: 0.156556 Jul 07 04:18:58.294938 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 637/1307] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:18:58 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:19:00.179164 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:00.183283 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-e919a3b4-7092-4c7b-bf73-66d9443be99a req-c40334b3-b054-4e15-815a-f27fa6966266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:19:00.186637 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:00.192891 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e919a3b4-7092-4c7b-bf73-66d9443be99a req-c40334b3-b054-4e15-815a-f27fa6966266 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:00.193418 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-e919a3b4-7092-4c7b-bf73-66d9443be99a req-c40334b3-b054-4e15-815a-f27fa6966266 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:00.198201 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:00.206334 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-e919a3b4-7092-4c7b-bf73-66d9443be99a req-c40334b3-b054-4e15-815a-f27fa6966266 service nova] Creating event network-changed:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:19:00.211524 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-e919a3b4-7092-4c7b-bf73-66d9443be99a req-c40334b3-b054-4e15-815a-f27fa6966266 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Jul 07 04:19:00.212309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 671/1308] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:19:01.223197 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2135217057"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:19:01.223784 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:19:01.230792 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:01.231245 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:01.232023 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:01.232754 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:01.369010 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.network.security_group_api [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Adding security group 75ee559f-294a-4adc-88f0-2aa82112be4e to port 0d495744-8d1f-4289-958a-f2edf04f5a6b Jul 07 04:19:01.720375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8f0db232-cdd8-44df-a266-e73923db64ca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action" status: 202 len: 0 microversion: 2.1 time: 0.501094 Jul 07 04:19:01.720980 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 638/1309] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:19:01 2022] POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:19:01.730145 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:19:01.731555 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:19:01.741132 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:01.741729 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:01.742868 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:01.743405 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:01.910279 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:19:01.919053 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2c416717-4ef2-4e2c-a3e3-42851a04c60d tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1760 microversion: 2.1 time: 0.192934 Jul 07 04:19:01.919748 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 672/1310] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:19:01 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1760 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:19:02.225679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-e2103d83-b04a-42fc-b3ff-e946c081a48c req-eba335ff-86a4-4518-b588-78a03f11847c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:19:02.234476 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-e2103d83-b04a-42fc-b3ff-e946c081a48c req-eba335ff-86a4-4518-b588-78a03f11847c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:19:02.234918 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-e2103d83-b04a-42fc-b3ff-e946c081a48c req-eba335ff-86a4-4518-b588-78a03f11847c service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:19:02.248110 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-e2103d83-b04a-42fc-b3ff-e946c081a48c req-eba335ff-86a4-4518-b588-78a03f11847c service nova] Creating event network-changed:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:19:02.253466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-e2103d83-b04a-42fc-b3ff-e946c081a48c req-eba335ff-86a4-4518-b588-78a03f11847c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031419 Jul 07 04:19:02.254062 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 639/1311] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:20:02.472558 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:20:02.473297 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=7 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:20:02.478475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:20:02.479468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:02.486423 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:02.486871 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:02.487623 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:02.488072 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:02.559619 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e424da6-753d-4783-a941-2d665a3cf3be tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action" status: 202 len: 0 microversion: 2.1 time: 0.088149 Jul 07 04:20:02.560312 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 673/1312] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:20:02 2022] POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:20:02.566723 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=5 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:20:02.567466 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=11 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:20:02.572447 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:02.573172 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:02.580589 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:02.581039 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:02.581801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:02.582261 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:02.733609 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:02.741492 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d047f17e-47af-4798-994d-589809a384aa tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1752 microversion: 2.1 time: 0.176710 Jul 07 04:20:02.742139 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 640/1313] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:02 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:03.759767 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:03.760426 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:03.767137 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:03.767583 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:03.768365 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:03.768804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:03.908766 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:03.917126 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-24b97e20-dc16-41c3-9c0e-6d7cd9dfe198 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.161822 Jul 07 04:20:03.917686 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 674/1314] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:03 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:04.934724 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:04.935334 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:04.941973 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:04.942416 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:04.943167 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:04.943599 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:05.082801 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:05.090630 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-8b5ec04e-0093-4519-910b-3684b78f4186 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.159772 Jul 07 04:20:05.091193 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 641/1315] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:04 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:06.108003 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:06.108711 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:06.115387 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:06.115829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:06.116603 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:06.117037 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:06.261408 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:06.269260 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dda8dd75-d1e4-4638-98ee-9377bdd3006b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.165855 Jul 07 04:20:06.269829 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 675/1316] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:06 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:07.286960 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:07.287569 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:07.293952 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:07.294394 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:07.295145 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:07.295571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:07.439930 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:07.448936 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-5dffe0f4-cc83-4b05-832c-3ae8f3895a5a tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.165845 Jul 07 04:20:07.449508 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 642/1317] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:07 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:08.466234 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:08.466848 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:08.473274 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:08.473721 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:08.474478 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:08.474912 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:08.618031 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:08.625894 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3d6dd4cc-2155-400d-a461-b426dda80f20 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.163499 Jul 07 04:20:08.626455 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 676/1318] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:08 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:09.643413 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:09.644019 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:09.651022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:09.651462 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:09.652209 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:09.652665 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:09.795579 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:09.803522 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-4aef00f9-46b9-441c-b9bd-bb86a3524092 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.164073 Jul 07 04:20:09.804094 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 643/1319] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:09 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:10.820816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:10.821467 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:10.828117 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:10.828590 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:10.829343 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:10.829804 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:10.969290 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:10.977069 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a3c8c908-e860-4bab-b06d-0a713d4305d1 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.160053 Jul 07 04:20:10.978225 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 677/1320] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:10 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:11.995700 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:11.996357 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:12.002735 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:12.003183 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:12.003929 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:12.004390 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:12.150063 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:12.157911 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-dd0041ff-cdce-49c0-b7e8-455d202f01ec tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.166813 Jul 07 04:20:12.158481 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 644/1321] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:11 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:13.175537 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:13.176162 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:13.184855 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:13.185309 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:13.186070 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:13.186508 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:13.327859 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:13.335616 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3fdd8a52-d5df-4c00-95d1-0b50aae98ed3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.164569 Jul 07 04:20:13.336168 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 678/1322] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:13 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:14.353485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:14.354103 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:14.360900 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:14.361347 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:14.362101 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:14.362541 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:14.510400 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:14.518278 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-9594d25b-82e6-4742-9359-4106a6b0e1d9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1757 microversion: 2.1 time: 0.169339 Jul 07 04:20:14.518857 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 645/1323] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:14 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:20:15.218151 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:20:15.218386 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:20:15.536063 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:20:15.536694 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:20:15.543422 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:15.543858 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:15.544642 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:20:15.545073 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:20:15.684438 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:20:15.692169 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8df03ed8-bf3a-4526-a4b3-ea9292f73c64 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1760 microversion: 2.1 time: 0.159883 Jul 07 04:20:15.692761 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 679/1324] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:20:15 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:21:19.065537 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_api:SELECT=12 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:21:19.066279 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG dbcounter [-] [117995] Writing DB stats nova_cell1:SELECT=36 {{(pid=117995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:21:19.070353 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2135217057"}} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:21:19.070880 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:19.077943 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:19.078387 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:19.079140 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:19.079571 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:19.211581 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.network.security_group_api [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Removing security group 75ee559f-294a-4adc-88f0-2aa82112be4e from port 0d495744-8d1f-4289-958a-f2edf04f5a6b Jul 07 04:21:19.542401 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-6aa90705-ccea-4bc9-b93a-e03f0e7dc7f0 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action" status: 202 len: 0 microversion: 2.1 time: 0.478460 Jul 07 04:21:19.546890 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 646/1325] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jul 7 04:21:19 2022] POST /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:21:19.558033 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=14 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:21:19.558895 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:21:19.728369 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-c25b5352-2a8b-445d-8714-0af869622404 req-1d20af24-1643-4319-ab69-3175ca2ac899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:21:19.740696 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c25b5352-2a8b-445d-8714-0af869622404 req-1d20af24-1643-4319-ab69-3175ca2ac899 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:19.741487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c25b5352-2a8b-445d-8714-0af869622404 req-1d20af24-1643-4319-ab69-3175ca2ac899 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:19.757511 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-c25b5352-2a8b-445d-8714-0af869622404 req-1d20af24-1643-4319-ab69-3175ca2ac899 service nova] Creating event network-changed:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:21:19.785585 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-c25b5352-2a8b-445d-8714-0af869622404 req-1d20af24-1643-4319-ab69-3175ca2ac899 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233235 Jul 07 04:21:19.786513 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 680/1326] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:21:20.626671 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:20.627346 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:20.633468 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:20.633990 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:20.634832 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:20.635271 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:20.717219 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.objects.instance [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lazy-loading 'services' on Instance uuid 8c832617-e992-4cea-acf5-4b0b6a4a51b0 {{(pid=117995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 04:21:20.789485 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-f926fa0d-b8c1-42e4-bd0b-521048a9cef9 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments/93452897-0eb5-4998-8591-fa644144b281" status: 202 len: 0 microversion: 2.1 time: 0.167156 Jul 07 04:21:20.790368 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 647/1327] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:21:20 2022] DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments/93452897-0eb5-4998-8591-fa644144b281 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:21:20.799962 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:20.800984 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:20.807369 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:20.807816 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:20.808653 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:20.809094 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:20.838629 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8dc394ed-f029-4fe7-8554-e54ac49b7a6f tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 Jul 07 04:21:20.839468 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 681/1328] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:21:20 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:21:21.831624 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [req-fb82f1ac-dd13-4987-99a3-656717e13836 req-0af0ddaa-8826-45b1-85e7-542df4d49434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:21:21.840427 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-fb82f1ac-dd13-4987-99a3-656717e13836 req-0af0ddaa-8826-45b1-85e7-542df4d49434 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:21.840868 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [req-fb82f1ac-dd13-4987-99a3-656717e13836 req-0af0ddaa-8826-45b1-85e7-542df4d49434 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:21.850954 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:21.851644 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.compute.server_external_events [req-fb82f1ac-dd13-4987-99a3-656717e13836 req-0af0ddaa-8826-45b1-85e7-542df4d49434 service nova] Creating event network-changed:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:21:21.852064 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:21.856713 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [req-fb82f1ac-dd13-4987-99a3-656717e13836 req-0af0ddaa-8826-45b1-85e7-542df4d49434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029036 Jul 07 04:21:21.857588 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 648/1329] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:21:21.859140 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:21.859668 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:21.860458 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:21.860888 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:21.889321 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9d9e324d-3dfa-4546-942c-81ba887aded3 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042239 Jul 07 04:21:21.889873 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 682/1330] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jul 7 04:21:21 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 04:21:21.902233 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:21.903507 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:21.912231 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:21.912781 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:21.913551 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:21.913987 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:21.994344 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] HTTP exception thrown: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 is not attached to volume 93452897-0eb5-4998-8591-fa644144b281 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Request method failure captured: Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments/93452897-0eb5-4998-8591-fa644144b281 HTTP/1.1 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixl6EGjh2RHoA4jIsriWHfMcAal4BUKYEn53iAtJDL8MnOsmg3r-ITpibcMsK3tY3TnzSqBkgRi-DHA5JsknP9j-Rx-TFHPEHSQGvm2rNMSbdp7IDyUMwGlsIUCIw0nedTDZYpWubPHKYZa5C_SOCs0IcKPJRWgh3gocikIhrFCuFW98 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: eb841fd811c449efb92c868fef5a089b Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:21:21.996961 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb841fd811c449efb92c868fef5a089b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: eb841fd811c449efb92c868fef5a089b Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-TestMinimumBasicScenario-360745202-project Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: a11499df74e44f7ca5f00dfa04034000 Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-TestMinimumBasicScenario-360745202-project Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:21:21.998853 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 is not attached to volume 93452897-0eb5-4998-8591-fa644144b281 Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'server_id': '8c832617-e992-4cea-acf5-4b0b6a4a51b0', 'id': '93452897-0eb5-4998-8591-fa644144b281'} Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 93452897-0eb5-4998-8591-fa644144b281. Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:21:21.999793 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 is not attached to volume 93452897-0eb5-4998-8591-fa644144b281 Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 is not attached to volume 93452897-0eb5-4998-8591-fa644144b281 Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:22.001249 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Returning 404 to user: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 is not attached to volume 93452897-0eb5-4998-8591-fa644144b281 {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:21:22.002359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-c5fc71fa-ed4d-4b55-b358-768fa2290011 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments/93452897-0eb5-4998-8591-fa644144b281" status: 404 len: 154 microversion: 2.1 time: 0.101945 Jul 07 04:21:22.002359 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 649/1331] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jul 7 04:21:21 2022] DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0/os-volume_attachments/93452897-0eb5-4998-8591-fa644144b281 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 04:21:23.132487 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:23.133055 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:23.139374 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:23.139815 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:23.140596 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:23.141027 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:23.167150 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 04:21:23.238935 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16df2e95-76d6-4a7b-b659-7c4b6fe1dc4b tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 204 len: 0 microversion: 2.1 time: 0.110021 Jul 07 04:21:23.239595 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 683/1332] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jul 7 04:21:23 2022] DELETE /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 04:21:23.247791 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:23.248482 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:23.254926 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:23.255375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:23.256137 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:23.256597 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:23.385363 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:21:23.393863 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-d7251344-b0da-4ed3-9bac-4f78717bb9bf tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1554 microversion: 2.1 time: 0.149959 Jul 07 04:21:23.394464 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 650/1333] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:21:23 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:21:24.411529 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:24.412147 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:24.418506 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:24.419100 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:24.419860 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:24.420318 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:24.551247 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:21:24.558606 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-133c393c-391d-4847-9bee-1f3c0bd3ac68 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1554 microversion: 2.1 time: 0.151363 Jul 07 04:21:24.559763 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 684/1334] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:21:24 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:21:25.576845 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:25.577553 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:25.583580 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:25.584022 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:25.584804 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:25.585235 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:25.716375 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.policy [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11499df74e44f7ca5f00dfa04034000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb841fd811c449efb92c868fef5a089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117995) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 04:21:25.724025 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-24d5f69c-fe41-4910-87c8-0471e884865c tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 200 len: 1554 microversion: 2.1 time: 0.151167 Jul 07 04:21:25.724651 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 651/1335] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:21:25 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 04:21:25.863670 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-946f1670-95c9-4672-b01c-3af75b473035 req-8b368af1-ee38-4aff-a300-22db77e51745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c832617-e992-4cea-acf5-4b0b6a4a51b0", "name": "network-vif-deleted", "tag": "0d495744-8d1f-4289-958a-f2edf04f5a6b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 04:21:25.873770 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-946f1670-95c9-4672-b01c-3af75b473035 req-8b368af1-ee38-4aff-a300-22db77e51745 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:25.874217 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-946f1670-95c9-4672-b01c-3af75b473035 req-8b368af1-ee38-4aff-a300-22db77e51745 service nova] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:25.885582 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-946f1670-95c9-4672-b01c-3af75b473035 req-8b368af1-ee38-4aff-a300-22db77e51745 service nova] Creating event network-vif-deleted:0d495744-8d1f-4289-958a-f2edf04f5a6b for instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 on hv-cinder-84684 Jul 07 04:21:25.892078 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-946f1670-95c9-4672-b01c-3af75b473035 req-8b368af1-ee38-4aff-a300-22db77e51745 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Jul 07 04:21:25.892712 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 685/1336] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jul 7 04:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 04:21:26.741399 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '>' {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:26.741981 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.compute.api [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] [instance: 8c832617-e992-4cea-acf5-4b0b6a4a51b0] Fetching instance by UUID {{(pid=117995) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 04:21:26.748469 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:26.748919 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:26.749679 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 04:21:26.750115 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG oslo_concurrency.lockutils [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Lock "5717acc1-d5f0-4013-b056-915d6f43a1e7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 04:21:26.763769 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.wsgi [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] HTTP exception thrown: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Request method failure captured: Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: request: GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 HTTP/1.1 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept: application/json Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Accept-Encoding: identity Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Connection: close Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Length: 0 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Content-Type: application/json Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Host: 10.222.0.20 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Openstack-System-Scope: None Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: User-Agent: python-urllib3/1.26.9 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Auth-Token: gAAAAABixl6EGjh2RHoA4jIsriWHfMcAal4BUKYEn53iAtJDL8MnOsmg3r-ITpibcMsK3tY3TnzSqBkgRi-DHA5JsknP9j-Rx-TFHPEHSQGvm2rNMSbdp7IDyUMwGlsIUCIw0nedTDZYpWubPHKYZa5C_SOCs0IcKPJRWgh3gocikIhrFCuFW98 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Id: None Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Domain-Name: None Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Identity-Status: Confirmed Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Is-Admin-Project: True Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Id: default Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Domain-Name: Default Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Id: eb841fd811c449efb92c868fef5a089b Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Project-Name: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Role: member,reader Jul 07 04:21:26.765305 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Roles: member,reader Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb841fd811c449efb92c868fef5a089b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb841fd811c449efb92c868fef5a089b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Id: eb841fd811c449efb92c868fef5a089b Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-Tenant-Name: tempest-TestMinimumBasicScenario-360745202 Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User: tempest-TestMinimumBasicScenario-360745202-project Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Id: default Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Domain-Name: Default Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Id: a11499df74e44f7ca5f00dfa04034000 Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: X-User-Name: tempest-TestMinimumBasicScenario-360745202-project Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: method: > Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: exception: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. Jul 07 04:21:26.767120 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: action_args: {'id': '8c832617-e992-4cea-acf5-4b0b6a4a51b0'} Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: {{(pid=117995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 04:21:26.768003 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. Jul 07 04:21:26.769452 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: ERROR nova.api.openstack.wsgi Jul 07 04:21:26.771190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: DEBUG nova.api.openstack.wsgi [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Returning 404 to user: Instance 8c832617-e992-4cea-acf5-4b0b6a4a51b0 could not be found. {{(pid=117995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 04:21:26.771190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO nova.api.openstack.requestlog [None req-de58007f-801d-4188-a765-1a9ef4aa8eca tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0" status: 404 len: 111 microversion: 2.1 time: 0.029201 Jul 07 04:21:26.771190 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: [pid: 117995|app: 0|req: 652/1337] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jul 7 04:21:26 2022] GET /compute/v2.1/servers/8c832617-e992-4cea-acf5-4b0b6a4a51b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 04:21:26.775686 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-02bd3f79-e810-4132-a2f7-7653ceec1bc4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] Calling method '.version_select at 0x7ff659e1a700>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 04:21:26.796475 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-02bd3f79-e810-4132-a2f7-7653ceec1bc4 tempest-TestMinimumBasicScenario-360745202 tempest-TestMinimumBasicScenario-360745202-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-643071137" status: 202 len: 0 microversion: 2.1 time: 0.024836 Jul 07 04:21:26.797040 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 686/1338] 10.222.0.20 () {58 vars in 1268 bytes} [Thu Jul 7 04:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-643071137 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 04:23:29.793684 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:23:29.794371 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:23:30.320221 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:23:30.320753 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:23:31.126830 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:23:31.126999 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:23:35.226434 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:23:35.226984 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:23:45.790561 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:23:45.791171 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:23:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:26:49.801946 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:26:49.802648 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:26:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:26:50.328918 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:26:50.329359 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:26:51.134867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:26:51.135046 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:26:55.236358 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:26:55.236915 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:27:05.799335 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:27:05.799867 dv-cinder-846842-11-iscsi devstack@n-api.service[117994]: Thu Jul 7 04:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 04:27:12.733741 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 04:27:12.734255 dv-cinder-846842-11-iscsi devstack@n-api.service[117995]: Thu Jul 7 04:27:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!